Claude 3.5 Sonnet: Is OpenAI Falling Behind?

I need this for my email as soon as possible.

Yeah, I'm like, imagining this workflow where, like, you're listening to your emails with some extra commentary.

There's something new being born there that never existed before.

OpenAI is starting to fall behind a little bit.

Hey, welcome to the Next Wave podcast. I'm Matt Wolf. I'm here with Nathan Lands, and today we're going to discuss a lot of the latest stuff to come out of the AI world. Things from Anthropic and OpenAI and HubSpot and all of these big players that are building stuff in the AI space right now. But we're not just going to talk about the news, we're going to talk about what the heck do we actually do with this stuff. You know, there's a lot of discussion going on in the AI world around. That's a really, really cool thing. But how would I actually use that in my life? Well, we're going to talk about that and some really cool stuff has come out from Anthropic and OpenAI lately, and we're going to give you our thoughts on where this might be going and how you can actually integrate this and implement it in your business.

So this week, I think the most exciting thing that I saw that's actually useful is the new Claude 3.5 sonnet. You know, I've been a big believer in OpenAI, and even though people were saying, hey, Claude's better at writing, I'm like, ah, but still, you know, with OpenAI and ChatGPT, I have my custom instructions and it knows more about me, it has more context about me. Well, now with the new Cloth, not only is it better than ChatGPT, but also they've added this new thing called Projects. And so Projects is basically like custom instructions, but better. For example, like with my newsletter, I created a project called the Lore newsletter, and then I gave it all these notes. So I said, like, here's kind of my writing style. Here are like two of my favorite newsletters and the kind of writing style that I've learned from. Here are my previous issues of the newsletter and also the kind of general template I use to lay out my newsletter every week. And that has made the Claude such a better editor than before. Like, before it had no context, like, who's Nathan? Or. Or like, what is he like? Or what's the newsletter? And now you don't have to do any of that. Like, it just knows all of it. And so it seems like, you know, yeah, for a newsletter, it's a Great use case. But it feels like this is going to be where companies can really start to find value with AI. Because my understanding too is you can actually share the projects, right? So you can make this for any kind of project and feed it all the context that's relevant for that project. And now everybody who's involved in that project, when they go into the AI, it's already got everything set up, so it knows, like, what you're trying to accomplish.

So honestly, I haven't played with the project's feature yet. You know, at the time of this recording, I've actually been traveling and I just got home and I haven't played with that yet. But they also rolled out a feature called Artifacts, where it puts this, like, sidebar inside of Claude. So on the left of your screen, you type your prompts and it looks just like Claude's always looked. But then on the right, whatever the sort of output you're looking for will show up on the right. So one of the very first things that I tested with that was I wanted to see if I can have it write a game for me and actually test the game straight in Claude without ever leaving the website. And it worked. I asked it, I made a very, very simple game. I said, hey, make me a Tic Tac Toe game and that I can play against the computer. And with a single prompt, it generated that game.

And.

And then it worked. First try. I mean, the computer actually sucked at Tic Tac Toe. Like, the logic of where it should place the thing wasn't there yet, but I would put my X's down and it would put an O down and I'd put an X down and it put O down and I, I beat it every single time. Cause the AI that it generated wasn't very smart for the game, but it was all playable right inside of Claude. I didn't even need to copy the code, paste it into a text document, open it as like a HTML file. Didn't need to do any of that. It just loaded up in this new artifact sidebar. And I was able to test it out. And I just thought that was like, so cool. You can test the code without ever leaving the website. And then if something doesn't work with it, you just go to the left side of your screen and say, hey, this didn't work. Fix it and it will rework the code and show it to you again in the right sidebar. And that was really, really cool. But I haven't actually played with the projects yet. I just know that you know, I have some custom GPTs that I made over in. Over in ChatGPT, where I mostly use them for, like, duplicatable processes that I find myself doing over and over again. Kind of like you mentioned for your newsletter. And one of the ways that I was using the custom GPT was I was taking all of the links from one of my YouTube videos, right? I usually have like 20 tabs open and I'm like, here's this thing, and then here's this thing, and then here's this thing, and then I take all of the URLs from those tabs. I would plug them over into ChatGPT and a custom GPT that I made. And I said, you know, create a resource list for me and it would give every single URL a sort of title, a URL, title, URL. And it used to work really, really good. When GPT4O came out, it actually broke that custom GPT. It stopped working for me. So I'm like. When you mentioned this just now that Claude has this projects and it's kind of similar to like a system prompt or almost like a custom GPT. I'm like, well, that sort of eliminated one of the use cases I used to go to chat GPT for.

Yeah, for sure. I mean, this is like the first time I feel like I can actually switch over. But you're talking about the artifacts thing. So another thing with projects is apparently you can share the artifacts. I'm imagining like two, you know, two teenagers who are like, coding on a project together, like, how cool that's going to be now, where they literally can go into the AI and say, hey, we want to make this little game together or this little website or whatever, and you can talk to the AI and you can actually see the.

And they're giving it away for free. Read the guide, get your AI questions sorted, and kick off the AI journey in your business today. Click the link in the description below. And now back to the show. I think one of the things that I'm. I'm sort of feeling lately is that OpenAI is starting to fall behind a little bit. And again, we've talked about this plenty of times on the podcast. We have no idea what OpenAI is doing behind the scenes, right? They're fairly secretive. Most of the stuff that they've announced and shown off, people didn't see that coming because they don't like to show it off until it's ready to show off. But lately it's starting to feel like companies like Anthropic are passing them in a lot of areas, you know, and other examples outside of the large language model is the video stuff. We actually kind of talked about this on a. On a different episode. But you've got Sora, which they announced seemingly to overshadow, overshadow Google. Right? Like when SORA was announced, I think it was the same week that Google announced Gemini 1.5 or whatever. It was a really big leap for Google with like a million token context windows. Well, that week OpenAI went and showed off Sora and nobody was talking about Gemini 1.5. Once they saw Sora, Sora was all anybody in the AI world was talking about or looking at or caring about. Right. Well, here we are several months later. We still don't have Sora access, but now We've got Luma AI video available. We've got Runway gen 3, which is about to be available, most likely before Sora. We don't have it yet, but most likely before Sora. And then you've got the demo that they did for the sort of advanced Audio Assistant, I think is what they call it. Right. They did that demo once again, I feel like they timed that demo to sort of slap Google. Right? Like Google had their Google I O event the same week. Like Google I O started on Tuesday. Well, what did OpenAI do? Monday we're announcing an event where we're going to make a big announcement. Right? They made this big amount announcement on Monday which kind of took some of the flair away from the Google IO event. Here we are a month later, we still don't have it. And the. They just made an announcement that, oh, it's getting delayed, we're pushing it out. It's not going to be rolled out. I mean, some people seem to be getting it, but for the most part they're telling us we're not going to get it till fall now. And it's like they're making all of these big announcements with the intention of sort of overshadowing Google. But then they're not actually shipping anymore. And I don't think it's a good look for OpenAI in my opinion. And it also kind of feels like it's giving a lot of these other companies an opportunity to catch up and pass them. Like Claude 3.5 is beating OpenAI and all of the LLM benchmarks right now. Like companies are starting to pass them up.

I agree that it's not a good look, but I'm still convinced that behind the scenes they're pretty far ahead. And like, and there's starting to be some evidence of that. It's like the, you know, the stuff was sore, even though.

Yeah.

They did a demo and it's not out yet. But the video that came out, I think it was yesterday. The Toys R Us commercial, have you seen that yet? I haven't showed that. I saw the news that's generated with Sora.

Yeah, I heard that. So.

So, so, Sora, there are deals going on behind the scenes where the technology is being used.

Right.

I think with Sora, it's probably just so expensive. They're like, yeah, we can't just roll this out.

Yeah.

Everyone is like. Like to pay, like, hundreds of dollars to use it. Like, people are, you know, they're not going to do that.

Should we show the Sora video or is that.

I mean, the video is not copyright. I know that.

That part's so cool.

Interesting. Yeah. The funny thing is, I didn't even know that Toys R Us was, like, back.

It's like, yeah, and they're back with Sora.

Yeah. Like, this was their introduction to go like, hey, look, we're here again.

Yeah. Yeah. And so, you know, I. I thought that commercial was pretty cool. Like, it, you know, is it perfect? No, but, like, that's the worst it's ever going to get. And you can see that they're able to accomplish things in that commercial that probably would have, you know, traditionally cost a lot, lot more, probably to the point where they never would have made that kind of commercial. It's just like, you're almost making, like, a short film at that point. I think that behind the scenes, that they're still doing quite well. I agree. They've kind of slipped up in terms of how they presented things. I don't. I don't think it's good that, like, I highly prefer how Claude's doing it where, like, they talk about something and then it's just out and, hey, try it. Like, you know, like the old Steve Jobs style. Like, I think that's way better, personally. But I still think, you know, you know, GPT5 is coming and it's. And it's probably way better than Claude. So right now, Claude's better for the moment, but, yeah, I guess we'll see.

Yeah, we'll see. We'll see. The Toys R Us video is interesting to me because I'm wondering what sort of reception it's going to get. Like, if it starts. I don't know if that's airing on TV already right now or if it's.

Yeah.

You know, Just kind of circulating on the Internet. But almost every scenario where I was used in this kind of thing, there was massive negative backlash, right?

Like, oh, there's. There. There is online right now. There is, yeah. For this. It's like, really? Yeah, it's really. Yeah. People are quite hateful. Like, you know, screw. You know, Toys R Us, screws stay dead and all this. It's like. Like horrible stuff. I don't get it.

I don't quite understand it. You know, I guess the argument is like, well, why didn't you just hire real people, real visual effects artists to go make that? You know, you would have employed more people if you did. But, I mean, they're a company that went bankrupt, you know, so, like, they're probably looking to cut some costs in some places.

Yeah, yeah.

But, yeah, I just remember, like, when the. There was that Disney plus show, the Secret. What was it called? Secret Agent, Secret Invasion, and parts of the intro were done with AI and, like, people were boycotting watching that show because the intro was made with AI, right? And, like, there was, like, a magazine post where there was, like, a clock. I don't remember exactly what the ad was for, but there was, like, an ad where, like, the clock in the background, people are like, wait a second. The numbers on the clock look weird. That image is A.I. you know, boycott this company. They use A.I. for their images. I don't understand that. Like, like, you're throwing the baby out with the bathwater. You're like, okay, because they use this one ad. The product that they're offering is no. Like, I don't know. It's a weird take to me that people are like, that passionate about, like, this company is saving costs by using AI Therefore, screw that company. But that seems to be the sentiment whenever this kind of stuff comes out. I don't know if that's, like, the vocal minority or if that's how most people feel. I kind of get the impression there's like, this vocal minority of AI haters. Most of the world is either like, AI is cool, or I really don't care one way or the other. But then there's this vocal minority of people that tend to speak the loudest on the Internet.

Yeah, I think. I think it's the vocal minority. But it will be, you know, interesting to see long term. Like, it's definitely gonna be like, one of the. The, you know, the biggest transitions in human history, at least in our lives, right? Where things are gonna radically change and a lot of it's gonna be good. And there's gonna be a lot of. There's gonna be some bad and complicated stuff, too, like we talked about before. Right. It's, you know, I. I think we should accelerate. But also at the same time, it's like. Yeah, but also, like, care about people because it's like some people are going to lose their jobs, you know, so we'll see how that works. Long term. I think there will be some backlash, but at some point, you know, like, you get these, like, the. The new show from Disney. I already forgot the name of the new Star wars show. It's. But it's. It's horrible. I like, it's all the commercial and they're like, chanting the power of one and all. It's like, it looks like me and my wife actually watched them all.

My wife and I have actually watched them all. And I know we're starting off on a tangent here. No, I think the show is horrible, but it's almost like I'm watching it now to watch this train wreck in slow motion.

There was an interview with the musician, Will. I am the guy who's been the Black Eyed Peas. And he said that, you know, the video stuff he's seen, you know, he feels like it is going to take power away from Hollywood and it's going to give it back to individual creators for them to create new things. And he thinks that's going to be, like, a more beautiful world where, like, people can bring it on the kind of stuff they want to see, you know?

Yeah. And.

And so I am hoping, like, technology gets way better and then Hollywood's like, has to, like, produce better films with humans in it and stuff that humans actually want to see. And then there'll be a whole other category, like you said, probably a niche of where people can use AI to make stuff that's personalized for them, what they want to interact with.

So, yeah, it's interesting. I definitely see the arguments, right? Like, I see the arguments of, like, okay, this is taking away the need to hire visual effects artists and things like that. But I also think that the visual effects artists that learn to, like, leverage a lot of these AI tools are going to be much better at their craft, you know, using all the tools that are at their disposal. Right. Why. Why let yourself get left behind? Because you're going to boycott a certain technology. Well, your competitors probably aren't gonna boycott that same technology. Like, it's ridiculous. But I do understand it's change. People are scared of change. But I think those that leverage it as another tool in Their toolbox will only get better at their craft.

Yeah. One of the other interesting things that came out this week was 11 Labs, the AI voice company. They rolled out this. This reader app. So basically, you can. You can feed it any document, and then you can use an AI voice to read it to you. So, like, if there was a book that didn't have an audio version of the book, you could have it read it to you. Or if there's a present or, I guess in theory, a presentation or any kind of PDF or anything like that, you could feed it to it. Feed it to it and have it read it to you. So, like, it feels like, like, that's going to be really powerful for people. Like, it feels like it moves us closer and closer to, like, not having to be on your computer all the time, right? Where you'll be able to go off and live your life and do work at the same time. Like, you can be going for a walk and staying healthy while hearing the presentation that your boss just sent to you or whatever. Like, yeah, I don't have time to, like, like, look at this moment, but, like, hey, let's just send that to 11 labs and have it read it to me while I'm, like, going off and enjoying my life for a little bit.

Yeah, no, that. That, to me, will be really interesting because it kind of makes it so, like, everything can be an audiobook, right? Like, articles you read online, they can be an audio book, like you mentioned. Like the memos from a meeting that you don't really feel like reading. Turn it into an audio book, Go for a walk and listen. Listen to the summary of the meeting. Right? Like, anything can be an audiobook or a podcast that you can listen to and multitask. You know, I need to run to the store real quick. I'll listen to the audio of this meeting that was generated while I'm there. Or I'll listen to this blog post that I came across on the way to the store real quick.

I told Amara, who's working over there, I was like, I need this for my email as soon as possible.

Yeah.

And then when it gets to the point where then you're able to actually, like, talk back to it and tell it how to, like, craft response back. I mean, we're probably, like, six months away from all this, which is awesome.

Do they have an API for that feature? I think 11 Labs has a pretty robust API, so if they don't, I bet they will soon.

Yeah.

And that sort of gives me ideas of, like, you know, using something like zapier or make.com that you can start tying these tools together. And every time an email comes in, automatically, send it over to the 11 Labs API, make an audio version of it, and then queue it up in my podcast player. Right. And then when you go anywhere, you just open up your podcast player and listen to all the emails that have come in in the last couple hours, you know, well, and what you could do too. And I'm just like, I'm. I'm sort of totally nerding out right now, but like, I like to make workflows with zapier and make.com and I'm like imagining this workflow where like an email comes in, it automatically sends it to the Anthropic API, has Anthropic add its own commentary to the email for you, and then sends that over to 11 labs, makes a podcast for you. And now it's like you're listening to your emails with some extra commentary. Like you can tell Anthropic, make me some jokes about this email. Make me some jokes about this contract. So as you're listening to the contract, it adds in a little bit of like, entertainment factors. You're more like interested in and reading it. You know, like every once in a while laugh at something that's said in this contract. So you could be listening to it and they're like laughing at the contract as they're reading it to you. Like, that kind of stuff I could actually see myself doing just to like, help me get through more of the content I'm trying to get through.

Yeah, I mean, so a lot of stuff we're talking about with the email, though, you know, a lot of that's, you know, maybe some of it could be doable with Zapier and other things. Right now I'm not sure what to go play with it and see, but if not, it's going to be available soon. But one thing you can actually use, like right now, which I've been finding really useful, is, you know, and this is, you know, I'm not saying it because Dharmesh is, you know, the co founder of HubSpot, but Dharmesh, the co founder of HubSpot, the CTO, launched this thing called Agent AI. And my understanding is he's building different agents for different business use cases. I'm not sure if that's going to get rolled up into HubSpot products or what, but what he has right now that you can use without even signing up is this thing where you can forward an email to agentagent AI. And then it basically connects it to an LLM and you can ask it things like, you can say, you can ask it a question about the email or you can ask it. The thing I've been finding very useful is summarize this email. Yeah, right. And I don't have to go anywhere else or anything. I literally just, you know, forward it to agent at agent AI and say, hey, this email that's like six paragraphs, paragraphs. Summarize it into like three bullet points.

And you're just writing that in the message that you send. So you're like forwarding it and then in the message that above the forwarded message. Yeah, asking a question or whatever.

That, that's all, that's all you do. And you get a response back in about 30 seconds. Mine was like 20 to 30 seconds every time I tried it. And it's great. It's like, you know, it's. I'm not sure what, you know, they're using behind the scenes. Maybe they're using Claude or you, whatever. But the responses are good. Like the summaries are pretty similar to what you'd get from putting it in the cloud. Of course, you could go copy and paste and do all that, but for a lot of people who don't know how to do all that, or, you know, who are not as fast at doing that as I might be, like, it's, it's super useful and you can use it. Like right now you just like forward the email. So anyone listening, I suggest if you haven't tried it, you've got emails that are like super long. You know, I suggest like, just try it out, like forward it. Forward an email at the agent, at agent AI and just say, hey, summarize this email. It's, it's pretty magical.

Yeah. Yeah. And so, yeah, there's a lot there to think about. You know, we, we talked about a lot of the new tools that are coming out. We talked a lot about the use cases that you might be able to use them for. Even talked a little bit about the future implications of where some of these tools might go. I think this has been a really fun, fascinating discussion. And if you enjoyed this discussion, make sure you like this. If you're watching it on YouTube and subscribe wherever you're listening, slash, watching this. If you're watching, watching it on YouTube, subscribe to us there. If you're listening on a podcast platform, subscribe to us there as well. We really appreciate it. It helps get this show more reach in front of more people. We can't thank you enough for tuning in and nerding out around AI with us. We really appreciate you. We'll see you in the next one.