Token optimization and routing will become essential AI services as cloud providers compete to lower inference costs. AWS and Google Cloud will offer built-in fine-tuning tools, and whoever doesn't aggressively cut token prices will lose customers to rivals undercutting them by half.
I think token optimization and token routing is going to be a core service that companies add. The larger players eventually will help you fine-tune and reduce the cost for you and do it in the most economical way. If you look at AWS, they try to help you save on the bill and we've even been pitched by Google, hey, switch to Google Cloud, we'll help you save X, Y, and Z on infrastructure and all of that. AI companies will try to save you as much money as possible in the long run because if they don't, a competitor will come by and say, hey, we can do similar things and we can do it for half the token price and here's how. And then you're going to start a lot of companies switch.
