What if superintelligence wasn't programmed, but simply emerged? | MOONSHOTS

I think I can see the endgame. I think we'll look back and say that superintelligence was just a compression-induced phase transition. What we're starting to see is if you take a reasoning model and you keep compressing, you find in the middle layers of that model what looks like a new phase, a more compressed phase where what they're calling global workspace or an analog of a global workspace takes place. It's almost higher-order reasoning where the model is able to turn in on itself and reflect. You could call it some analog of awareness, consciousness, if you like. But it looks to me like the middle layers in their model are performing sort of a higher-order calculation. I think history will reflect that much of neuroscience that folks in the field thought was just complexity that was difficult to interpret or understand was again just the complexity of our ancestral environment seen through the distorted mirror of compression.