A short transcript excerpt of Palmer Luckey expressing nuanced concerns about AI: he worries more about malicious human misuse (including bioweapons and irrational actors in conflict) than about an autonomous ‘Skynet’ takeover. He defends working on military autonomy (Anduril) with human-in-the-loop safeguards and argues the U.S. must participate to set international norms for AI use. He is cautious but believes the risks can be managed.
Chapters
I am worried about the potential of autonomy to do really spooky things, especially kind of like the Skynet scenario, you know, takes over all the weapons and then nukes us all. But it's actually near the bottom of a long list of things that I'm concerned about. I'm very concerned about very evil people using very basic AI. I'm much more worried about that than I am about extremely advanced AI wanting to wipe us out on its own. I'm more worried about the bioweapon stuff that I talked about. I'm more worried about people who are doing things irrationally in continu conflicts because they're the hardest to predict and the hardest to counter. And down near the bottom of that list is the Skynet scenario. Now, in the meanwhile, there's of course a lot of fears people have around autonomy and the way that it's used in conventional conflict. I think that the only way that you can impact that is to actually do it. It's like with Anduril, we always have a human in the loop. There's always a person who's telling the AI what to do. It's not making any life or death decisions without a person who's directly responsible for that happening. And, and so there are some people who say, oh, how can you work on autonomy when it has so many ethical problems? Like, oh, you think the moral high ground is to wash your hands of it and let people who don't care about those things work on it. There's no moral high ground in ensuring that less competent, less principled people work on these problems, at least in my view. And on top of that, I think autonomy is going to be similarly important compared to nuclear power. Imagine if the United States had tried to set international norms around the use of, of nuclear weapons or nuclear power. If we had not had any nuclear weapons or nuclear power, it would have been a joke. We never could have done it. The only way the US in particular can lead is if we actually are involved. That's the only way that we could potentially help regulate artificial intelligence in a way where it doesn't become a really big travesty internationally. So I'm spooked about it, but I think we'll manage it.