Jason M. Lemkin tested Perplexity, ChatGPT, and Claude on a question about SaaStr. Perplexity gave accurate, current information about SaaStr's AI focus and community initiatives. ChatGPT returned outdated details about pre-COVID events. Claude got it right but only after a web search, making it slower and wordier.
Chapters
I fell more in love with Perplexity because it won. I, I don't know the, but as I just ran a quick experiment while we're here, I went to Perplexity, ChatGPT, and Claude, and I asked it a basic question. Tell me about Saastr and where it's going. That's a personal question to me. Yeah. Right? Perplexity was much better. Much, much better. ChatGPT, which I'm not a fan of for this use case, I don't think it's that good, got stuff wrong. Okay. And Claude blabbered on and on, but, but actually it had to pause and do web research which Perplexity didn't have to do. So as from a user experience, I mean, it's, it's okay. Like, but, but Perplexity won. So I don't know what that, I mean, I don't know what that means for 2028, right? And I don't know how important that use case is, but this original idea of building a better, like, usable search, it much, it's, it's, it for this, it's much better if that's your focus, right? And these are, you know, ChatGPT is so broad. This is the, the interface to all of knowledge. Totally. Right. That's the thing. ChatGPT is very— I don't think it makes the best images. I can't use it for images. I use Reave. I can't use it for a lot of things that it does, but it's not the best at. But Perplexity just crushed this question. This is a real-world thing that's important to me. Tell me about Saastr and where it's going. It got it right. It got the events right. It said AI-first transformation, expansion of content and format, global community branding, stronger networking. ChatGPT got it wrong. It talks about what have we been doing since COVID We're doing hybrid events like Hopin. I mean, ChatGPT, wake up. What, what, what, what year are you in, right? Someone that doesn't own their LLMs, right? I just, I, I'm not, I just, at $18 billion, I don't know the answer to the question, right? I mean, it's, uh, it's, um, but I, this, this, I, I, I just fell more in love with Perplexity on this. I fell more in love with Perplexity because it won, it won the bake-off.
