Three speakers debate how ideas spread like viruses through society. One warns that self-reinforcing memes are dangerous and proposes treating them with skepticism. Another sees AI as a chance to map all human ideas and understand what makes certain thoughts stick.
An AI mind virus sounds really scary. Is it scary?
For me, this is very, very scary. Mind virus is not about how AI thinks. It's like, it's how civilization thinks. Memes are like the operating system for collective society. We don't spread genes very quickly, but we spread ideas very quickly. And every civilization is built on memes. If you can mess with those, like the data center trope that we're all kind of dealing with, ideas become really contagious. And so groupthink becomes very hard to reverse if you get into that. The kind of danger of the wrong idea spreading at light speed. This is very, very difficult because all the nodes reinforce each other and the belief becomes self-validating. This is very, very dangerous in my opinion. I don't know. We're going to need a zero-trust architecture for memes. It's like crazy. I think this is wonderful. Of course.
And I view this pretty optimistically as a laboratory for anthropology. Now, for the first time, because these models are effectively, among other things, compression of all human knowledge and experience, now we have a laboratory in silico If it really is the case that our models now, compressed models of human knowledge, are so powerful that they're showing memetic behaviour and mind viruses, let's launch a human meme-ome project to exhaustively map all possible human memes, all human mind viruses. And let's just, like, understand the full landscape of all human mind viruses that could be out there.
Can you imagine if you could map them, the velocity at which they move, and analyze that? You could optimize for the spread of memes. Correct. And he gives you a chance to introspectively look at how you think in an objective fashion and then change potentially your thinking.
