Eric Siu explains why AI companies will eventually help you spend fewer tokens. Just like AWS offers reserved instances to cut cloud costs, LLM providers have incentives to build token optimization tools and consulting services that reduce your bills while keeping you locked in.
Like, to my point, what I just made earlier, I think token optimization and token routing is going to be a core service that companies add. And I actually think you're going to have it. I think I'm going to have it too, as a service. I don't know if we're going to have it as a service. I genuinely believe that the larger players will eventually, I'm not saying in the short run, eventually will help you fine-tune and reduce the cost for you and do it in the most economical way. If you look at AWS, You know, and you take your cloud bill, they try to do reserved instances, they have consultants, they try to help you save on the bill. And we've even been pitched by Google, hey, switch to Google Cloud, we'll help you save X, Y, and Z on infrastructure and all of that. And that's why I believe that the LLMs themselves or the AI companies will try to save you as much money as possible in the long run, because if they don't, a competitor will come by like a Google and say, hey, we can do similar things and we can do it for half the token price, and here's how.
