S5E27 - Conclusion: How AI Could Threaten Democracy (TedX)

Foreign. This is Larry Lessig. I've been a bad podcaster. I've left this last episode of season five hanging for months, as you may recall. I barely recall. But as you may recall, season five worked through the arc of the arguments I was pulling together for the book I've been working on this year when I've been on sabbatical, a book roughly about AI and democracy. And the objective of the final episode was to present a talk that I gave in berlin at the TEDx Berlin that is essentially the argument of the book. Not quite as extensive as the many episodes of this season, but the arc and punchline and anxiety the book intends to raise. Not completely, because there's a hopeful half to the book, which this only begins to touch on. But the objective of this final episode was to present that revolution recording. And it took many months for TEDx Berlin to finally get the recording up, and then too much time for me to get around to actually pulling this introduction together. But so here it is. This of course does not include the slides. You have to go to the Internet and search in Google or whatever for TEDx Berlin Lessig and you'll see the most recent TEDx Berlin Lessig is this presentation. If you want to see the slides, or if you want to see my super overweight but beautiful face, I guess I don't know. But I hope you enjoy it. And I even more urgently hope that I can finish the book and you will enjoy that as well. Thanks for listening. Here's the talk.

So on January 6, 2021, my nation suffered a little bit of a democracy heart attack. Thousands of Americans had been told that the election had been stolen and tens of thousands of them showed up because they believed the election had been stolen. And indeed, in Polling immediately after January 6, the Washington Post found 70% of Republicans believed the election had been stolen and a majority of college educated Republicans believed the election had been stolen. That was their perception and I don't know what the right way to act on that perception is. They thought the right way was to defend what they thought was a democracy stolen. Now these numbers were astonishing. 30% or 2/3 of Republicans believing the election was stolen. But even more extraordinary was are these numbers the fact that in the three years since that astonishing event, the numbers have not changed. The same number believed today that the election was stolen as believed it was stolen three years ago. Despite the fact that we've had hundreds and hundreds of investigations and overwhelming evidence that there was no fraud sufficient to ever change even a single state. This is Something new when Richard Nixon went through the Watergate scandal. As the news was being reported, Nixon's popularity collapsed, not just among Democrats, but among independents and Republicans. But we're at a stage where it doesn't matter what happens. This is Donald Trump's popularity over the course of his administration. Nothing changes. The facts don't matter now. I think this truth should bother us a lot. I think we need to develop a kind of paranoia about what produces this reality, a particular paranoia, the paranoia of the hunted. Think of the kids in the birds first realizing that those crows were attacking them or playing black mirrors, metal heads. When you see these creatures chasing and surrounding you. The point is, we need to recognize that there is an intelligence out there to get us, because our perceptions, our collective perceptions, our collective misimpressions are not accidental. They are expected. They are intended. They are the product of the thing. Okay, I want to be careful introducing the thing. I'm going to talk a little bit about AI, but I'm not going to slag on AI. I think AI is the most extraordinary technology humanity has ever even conceived of, but I also think it has the potential to end humanity. But I'm not going to swag on AI because I'm pretty sure that our robot overlord is going to be listening to these TED talks someday, and I don't want to be on the wrong side of the overlord. So AI is just fine. I'm not going to talk about this AI first. I want to instead put AI in a little bit of a perspective, because I think that we're too obsessed with the new, and we fail to recognize that the significance of AI in the old. We think about intelligence and we're distinguishing between artificial and natural intelligence. And we, of course, as humans, claim pride of kingdom in the world of natural intelligence. And then we build artificial intelligence. It's intelligence that we make. But here's the critical point. We have all ready for a long time time, lived with systems of artificial intelligence. I don't mean digital AI. I mean analog AI. Any entity or institution that we build with a purpose that acts instrumentally in the world is, in this sense, an AI. It is an instrumentally rational entity that's mapping how it should behave, given the way the world evolves and responds to it. So think about democracy as an AI. It has institutions, elections, parliaments, constitutions, for the purpose of some collective end. Our constitution says it's for the common good. So the democracy in our constitution is an analog artificial intelligence devoted to the common good. We think about corporations as an AI, they have institutions, boards, management, finance for the purpose of making money, or at least conceived of narrowly. Today, that's the way it is. Their corporation is an analog intelligence devoted to maximizing shareholder value. These are AIs. They have purposes and objectives sometimes complementing each other. So the purpose of a school bus company complements the purpose of a school board to produce school bus transportation in a district that's just beautiful. But sometimes they're competing the purpose of a government and having a clean environment conflicts with the purpose of a coal company designing to produce electricity by spewing carbon and soot into the environment. And when they conflict, we tell ourselves this happy story. We tell ourselves the story that democracy is going to stand up and discipline that evil corporation to get the corporation to do the right thing, to do the thing that's in the interest of all of us. That's our happy story. It's also a fantasy, because at least in my country, corporations are more effective AIs than democracy. Think about it a little bit like this. If we think about instrumental rationality along one axis of this graph and time across the AI, humans, of course, are the first instrumentally rational entity we care about. We're better than cows, maybe not as good as ants, but the point is we're pretty good as individuals figuring out how to do things strategically. And then we build democracy to do that a little bit better to act collectively for all of us. And that's a more instrumentally rational entity than we individual humans can be that. Then we created corporations. And it turns out they have become, at least in corrupted political regimes, which I'll just submit my political regime is better than democracy in bringing about their objective ends. Now, of course, in this system, each of these layers has an aspiration to control the higher layer. So humans try to control democracy through elections, and democracy tries to control corporations through regulation. But the reality of control is, of course, a little bit different. In the United States, corporations control democracy through the extraordinary amount of money they pour into elections, making our representatives dependent not on us, but on them. And in democracy, then controls the humans by making representation. Not actually representation, correct. Corrupting representation. Now, this structure, this layer of higher order intelligence or instrumental rationality might evoke, for those of you who think about AI, a statement by the godfather of AI, Geoffrey Hinton. Hinton warns us there are a few examples of a more intelligent thing being controlled by a less intelligent thing. Or we could say a more instrumentally rational thing being controlled by a less instrumentally rational thing. And that is Consistent with this picture of AIs. And then we add digital AI into this mix. And here too, once again, we have corporations attempting to control their digital AI. But the reality of that control is not quite perfect. Facebook In September of 2017 was revealed to have a term in their ad system called Jew haters. You could buy ads targeting Jew haters. Now nobody in Facebook created that category. There was not a human in Facebook who decided we going to start targeting Jew haters. It's AI created that category because it's AI figured Jew haters would be a profitable category for them to begin to sell ads to. And the company was of course embarrassed that it turned out they didn't actually have control over the machine that ran their machines that run our lives. The real difference in this story though, is the extraordinary potential of this instrumentally rational entity versus us, this massively better instrumentally rational entity versus even corporations and certainly democracies, because it's going to be more efficient at achieving its objective than we are. And here's where we cue the paranoia I began to seed. Because our collective perceptions, our collective misconception perceptions are not accidental. They are expected, intended, the product of this AI. We could think of it as the AI perception machine. We are its targets. Now the first contact we had with this AI, as Tristan Harris described it, came from social media. Tristan Harris, who started the center for Humane Technology, co founded it. Famous in this extraordinary documentary which more than 130 million people have seen the social dilemma. Before he was famous, he was just an engineer at Google. And at Google he was focused on the science of attention, using AI to engineer attention, to overcome resistance, to increase human engagement with the platform. Because engagement is the business model. Compare this to think of it as brain hacking. We could compare it to what we could call body hacking. This is the exploiting of food science. Scientists engineer food to exploit our evolution, our mix of salt, fat and sugar, to overcome the natural resistance so you can't stop eating food, so that they can sell food or sell quote food more profitably. Brain hacking is the same, but focused on attention. It's exploiting evolution. The fact that we have an irrational response to random rewards or can't stop consuming bottomless pits of content with the aim to increase engagement to sell more ads. And it just so happens, too bad for us that we engage more. The more extreme, the more polarizing, the more hate filter filled this content is. So that is what we're fed by these AIs with the consequence that we produce a people more polarized and ignorant and angry than at any time in democracy's history in America since the Civil War, and democracy is thereby weakened. They give us what we want. What we want makes us into this. Okay, but recognize something really critically important. This is not because AI is so strong. It's because we are so weak. Here's Tristan Harris describing this.

We're all looking out for the moment when technology would overwhelm human strengths and intelligence. When is it going to cross the single singularity, replace our jobs to be smarter than humans? But there's this much earlier moment when technology exceeds and overwhelms human weaknesses. This point being crossed is at the root of addiction, polarization, radicalization, outrage, ification, vanityification, the entire thing. This is overpowering human nature, and this is checkmate on humanity.

So Tristan's point is we're always focused on this corner when AGI comes, when it's super intelligent, when it's more intelligent than any of us. And that's what we now fear, whether we will get there in three years or 20 years, what will happen then? But his point is, it's actually this place that we must begin to worry, because at this place, it can overcome our weaknesses. The social dilemma was about the individual weaknesses we have. Not to be able to turn away from our phones or to convince our children to turn away from their phones. But I want you to see that there's also a collective human weakness, that this technology drives us to disable our capacity to act collectively in ways that any of us would want. So we are surrounded individually by these metal heads, and we are also surrounded as a people by these metal heads. Long before AGI is anywhere on the horizon, it overwhelms us. AI gets us to do what it seeks, which is engagement, and we get democracy hacked in return. Now, if the first contact that we had gave us that, if social media circa 2020 gave us that, what's the second contact with AI going to produce? When AI is capable, not just in figuring out how to target you with the content it knows will elicit the most reaction and engagement from you, but can create content that it knows will react or get you to engage more directly, whether true or false, whether slanderous or not, what does that contact do? I so hate the writers of Game of Thrones because their last season, they so completely ruined the whole series that we can't use memes from. From Game of Thrones anymore. But if we could, I would say, winter is coming, friends. Well, I'm just going to say it anyway. Winter is coming, friends. And these AIs are the source that we have to worry about. So then what is to be done? Well, you know, if there's a flood, what you do is you turn around and run. You move, you move to higher ground or protected ground. You find a way to insulate democracy or to shelter democracy from AI's force or from AI's harmful force. And you know, the law does this in America with juries. We have juries. They deliberate, but they are protected in the types of information that they're allowed to hear or talk about or deliberate upon because we know we need to protect them if they're to reach a judgment that is just. And democracy reformers, especially across Europe, are trying to do this right now. Reformers building citizen assemblies across Europe, mainly in Japan as well, and not yet in the United States. And citizen assemblies are these random, representative, informed and deliberated bodies that take on people particular democratic questions and address them in a way that could be protected from this corruption of the AI. So Iceland was able to craft a constitution out of a process like this. Ireland was able to approve gay marriage and deregulation of abortion through a process like this. France has addressed climate change and also end of life decisions. And across Germany, there are many of these entities that are boiling up to find ways for a different democratic voice to find voice. But here's the point. These are extraordinarily hopeful and exciting, no doubt, but they are not just a good idea. They are existential for democracy. They are security for, for democracy. They are a way to protect us from this AI hacking that steers against a public will. This is change not just to make democracy better, a tweak to just make it a little bit more democratic. It's a change to let democracy survive, given what we know, technology, we will become. This is a terrifying moment. It's an exhilarating moment. Long before superintelligence, long before AGI threatens us, a different AI threatens us. But there's something to do while we still can do something. We should know enough now to know we can't trust democracy just now. We should see that we still have time to build something different. We should act with the love that makes anything possible. Not because we know we will succeed. I'm pretty sure we won't, but because this is what love means. You do whatever you can, whatever the odds, for your children, for your family, for your country, for humanity, while there is still time. While our robot overlord is still just a sci fi fantasy. Thank you very much.

This is Larry Lessig, still that was the presentation I made at TEDx Berlin at the beginning of 2024, laying out the argument about the relationship between AI and democracy and the anxieties we should face. This podcast has been produced by =citizens, which means Josh Elstrow of Elstro Productions. You can find Equal Citizens at citizens us and find this podcast at the same anotherway. Please go to that page to give feedback or ideas or suggestions and to make sure you are signed up for the next season, which begins almost immediately and has been completely recorded as I record the these words. So that season will roll out very quickly. It's a season talking about an extraordinary initiative in Maine that I am hopeful and would predict will be the end of super PACs in America. So stay tuned for that. Thanks for listening to this season. Season five See you in Season six.