A new study finds AI text detectors fail across different models and text transformations. Some techniques reliably fool them. OpenAI withdrew its own detector because it was too easy to bypass, so relying on detectors alone won't catch AI-written text.
AI detectors cannot be trusted. This new study finally confirmed this. It looks at GPT4 and the accuracy in predicting if the text is actually AI generated or not. And the one thing I want you to notice is how all over the place this is okay, all the way from bart completely falling apart when you use some of these techniques to GPT becoming more AI like when you use certain techniques and less AI like if you use others. In other words, it depends what model you're using. And there's all these techniques that can fool these detectors pretty reliably. So this just confirms that we already talked about on the channel when it happened and that is that OpenAI withdrew their AI detection software because it just did not work reliably. No matter what they did, it was too easy to fool. So just using AI detectors is not going to be a solution for this whole problem of how do we identify AI written text. This is just a part of society now and you have to find other ways of dealing with it.
