A startup built an AI chip using 10,000 times less energy than GPUs, enabling dense compute for wearables and robots. The power grid can't handle AI's exploding demand, so the real solution is reinventing the hardware-software stack from scratch. AI tools are now speeding up the design of the next generation of chips.
Chapters
using 10,000x, not 10x, 10,000 times less energy, not percent, than a GPU. That's a big deal because you get far more intelligence per watt. You can densify intelligence massively, so you can have much more compact systems that are much smarter. So in order to have AI chips in everyday wearables and our robots, having robot brains, in order to have intelligence at the edge. And of course, even our data centers in order to serve the insatiable demand for intelligence, you know, we're running out of power right now. It's very difficult to scale up the power supply to keep up with the AI demand. It's putting a lot of stress on our grid. By some projections, we definitely need to double our grid, if not 10x it, if we want to serve the whole population, never mind trying to achieve having, you know, a billion manufacturing robots humanoid robots. We can't, we don't have the power grid for that right now. And so instead of just scaling up the current paradigm, which is what everyone's doing, which is a short-term strategy, we're taking the longer-term strategy, which is to densify compute. We have to reinvent the whole stack from scratch. That's a huge challenge, but we've made a ton of progress. And now that we can use AI to even accelerate our own work, that progress is accelerating. So it's kind of, yeah, it's kind of the final form of AI assembling itself for the future through us, in a way.