Matt Wolfe argues that companies use "too powerful to release" claims to hype their AI and attract capital, though he acknowledges real security risks. Concerns have shifted from disinformation to hackers exploiting capable models to compromise products from Apple, Microsoft, and Nvidia.
Chapters
This isn't the first time we've seen this sort of narrative of this model is too powerful, we cannot release it to the public. There is some benefit to these companies going out and saying, we have the most powerful model the world has ever seen, it is so scary, we need to lock it up, because, well, that helps them raise capital, that sort of postures them as the company building the smartest, best thing ever in the world of AI, and it gets people pretty hyped up for when they finally can get their hands on a model like this. Saying all of that, I do actually think this time it's kind of warranted. I mean, it was kind of warranted in the past as well. The reasons they were saying GPT was too powerful was they were saying it could be used to flood the internet with fake information and propaganda and basically slop. And well, it kind of did. Fast forward to today, and now they're saying, look, if this model gets released into the world, it is so good that hackers and bad actors are going to have a field day with this, and no products are safe. So if I'm being totally honest, I do think there's a little bit of a marketing play here, but I don't actually think that's their intention. This is just my gut feel on it from everything I've read and everything I've heard from others. It is pretty damn important that these companies get locked down before new vulnerabilities pop up. I want to know that my Apple products and my Microsoft products and my products that are powered by Nvidia and Cisco and CrowdStrike and the various security layers behind the scenes are locked down before stuff like this gets released on the world. I actually think that's kind of a good idea, personally.