Eric Siu responds to Jensen Huang's claim about a $500K engineer spending $250K on tokens. High token spend isn't necessary. Open-source models offer a much cheaper way to get productivity and marketing gains from AI.
Jensen Huang from Nvidia said that he would be deeply alarmed if a $500,000 engineer was not spending $250,000 worth of tokens. What he's trying to say is he wants people to use AI to do their jobs more efficiently. But even outside of that fact, I do agree with him. I don't think they need to spend $250,000 worth. I'm all for them using AI very heavily, but a lot of it should be through open source because there's a lot of amazing open source models, and maybe it costs you $30,000 grand instead of $250 grand and you still get the same result. I do believe if the pitch is, hey, AI will make you more efficient and save you more money in marketing or whatever you want to do, well, at the same time, why don't I just try to use other models that are cheaper and cut costs even more? When Jensen says, oh, I want everyone to spend $250K worth of tokens, the efficiencies you gain from it, or it's equivalent to not using the internet today. So I do believe directionally he's correct.
