Eric Siu pushes back on Jensen Huang's claim that a $500k engineer should spend $250k yearly on AI tokens. Open-source models can deliver similar gains for around $30k, making Huang's number wasteful when the goal is just making engineers faster.
Jensen Huang from Nvidia said that he would be deeply alarmed if a $500,000 engineer was not spending $250,000 worth of tokens. What he's trying to say is he wants people to use AI to do their jobs more efficiently. But even outside of that fact, I do agree with him. I don't think they need to spend $250,000 worth. I'm all for them using AI very heavily, but a lot of it should be through open source because there's a lot of amazing open source models and maybe it costs you $30,000 grand instead of $250 grand and you still get the same result. I do believe if the pitch is, hey, AI will make you more efficient and save you more money in marketing or whatever you want to do, well, at the same time, why don't I just try to use other models that are cheaper and cut costs even more? When Jensen says, oh, I want everyone to spend $250K worth of tokens, the efficiencies you gain from it, or it's equivalent to not using the internet today. So I do believe directionally he's correct.
