Running AI on phones matters less than expanding context windows eightfold, which lets models handle complex problems like nuclear fusion simulations. The speaker predicts a 100x leap in AI progress this summer, after years of 10x annual improvements.
Chapters
You can run a big model on your phone. Uh, yeah, you can save a lot of money on memory, but that's not really the important part. The important part is the smartest AIs now can have about 8x more context, which means if you're doing something really complicated, you know, nuclear fusion simulation or whatever, the, the effective brain memory that's thinking about a single problem in a single moment is 8 times bigger. And the other reason it's really important is because it locks in my prediction for the year was definitely going to be right. You know, I said this is going to be a 100x year. You know, we've been, we've been doing 10x years for the last 7 or 8 years. This is going to be a 100x year. It's going to be 100x by summer. I'm gonna, I'm gonna blow away that prediction. Uh, but this is a big part of, of why.