Cameron Herold warns that AI voice messages are fueling scams, including fake emergency calls demanding money. ElevenLabs built a free classifier that detects its own AI voices with about 90% accuracy. The real fix requires AI companies to build safeguards into their products, not just hope people spot the fakes.
Chapters
One of the big scary are these audio messages, like voice messages that someone is getting from their mom. I'm in trouble. Don't call me. Don't email me. Send money to this number or they're going to kill me. And it's a fake. How are we preventing those kinds of things from happening?
Yeah, there's so many aspects to this and definitely something also that's really important to think about and to continue thinking about. And I think a huge component of this is education, being aware or creating that awareness in the public that AI can now be be almost anywhere and to have a critical eye when being confronted with a piece of content. I remember when Photoshop was being used more and like you would see posters of photographs and you would think like, oh my God, these people are flawless. And then I think the next shift of hearing content should be to think like, is this real or is this generated? So I think there's a huge educational component, but of course a single company Like, it would be lazy to say the public just has to be aware and then we solve it. There are also safeguards that we can roll out as part of developing the tech. And I think every AI company that is innovating at the moment has an ethical responsibility to develop safeguards. We also have a service called AI Speech Classifier where you can upload audio snippet and it will tell you whether it was generated with ElevenLabs. So if you were targeted and got a voice memo saying, I'm in trouble, don't email me, don't text me, You could upload it to the AI voice classifier. You don't even need an ElevenLabs account for that, and then it will tell you with 90% certainty whether or not it was created
