Why Everyone’s Freaking Out About Claude 4 (With Examples)

Igor reviews Claude 4's new models, Opus and Sonnet, showing they write more naturally and code more reliably. Opus 4 scored 72-80% on software engineering benchmarks. He demos it building a 3D RPG, a finance dashboard, and a Chrome extension in single prompts, plus new features like agents that run for hours and prompt caching that lasts up to an hour.
Chapters
Okay, so we just got the brand new Claude models from Anthropic. The Internet is going crazy. Concretely, we're talking about Claude for Opus and Claude for Sonnet. And I think the hype right now is actually justified because we're going to be looking at various ways to use this thing and how it performs in comparison to some of the competition in this very video. But let me just tell you, writing style, unmatched coding ability. Well, it matches the demos that we just saw on Google I O, even with the web interface. But not just that, it goes further. It builds these things that are way more complex in one shot. No problem. It's smarter, it performs better on benchmarks. It just looks very solid overall. But the real question isn't if the benchmarks are good. The real question is, is this thing actually any good in practice? Should this become your new daily driver? The short answer to that is probably. And at the very least, you should consider and test this literally yourself. Because this thing goes above and beyond what we've seen from all other models on things like writing, coding, context retention. We'll talk about the developer side of it too, but mainly we'll be focusing on examples for the web interface here. And before we get into it, which I'm very excited about, and this is going to be grounded in multiple examples and experiences with these models. And we're going to talk about this as we do with new launches. But I want to point out one thing which is Anthropic actually gave me access to this a few days in advance before this launch, and that also makes this video actually sponsored by Anthropic. But I told them straight up, like, I'm only doing these videos if I can kind of give my opinion, and if the opinion would not confirm with what they want, then too bad, like, we're not going to be able to do this because I got to keep these reviews honest and grounded in examples. So I hope that this video is going to show you various examples and use cases of this, because they're seriously impressive. But first, we got to go over what has been released here. As I said, this has been shipped all across their platforms, the two models that I mentioned. So Claude for Opus, Claude for Sonnet. If you look at the web platform Claude AI, then you'll see that immediately these are available to you if you're on one of the paid plans. Right now, I'm on the max plan over here. If you use Claude code, you can just type model and switch to Opus right here. So that's available too. And they're available through the API today, which is amazing. No fuss. Rollout went super smoothly. Okay, so what's new? Well, this part is actually pretty quick. It's really the model performance that is the most impressive thing here. But essentially they released these new models. There's some examples here, but mostly it performs better on coding, it performs better on writing. They make all of these claims, but they hold. Okay, so first up, I want to look at one benchmark that they lead with here. This is the SWE bench. These are practical software engineering examples from the real world. And this is just one thing that all of these new models, new frontier models that can think measure themselves on. Okay. They are basically different coding problems that coders would face in the real world. Okay, so what does this look like? Well, they're the best in the world on them, just straight up. The Sonnet model actually being slightly better, which is interesting because it's way, way cheaper. But basically they just smashed these benchmarks completely. For reference, I want to pull up where we were six months ago with 01. Remember the first thinking model out of OpenAI and what was it? November 2024, I believe. Well, if you pull these up side by side, you will quickly realize how far we've come in such a short amount of time. Back then, cracking 30 to 40% of these problems was considered quite groundbreaking. Like incredible that it can do most of these tasks that software engineers face. Well, right now we're looking at 72, up to 80% with these caveats here. So incredible. Okay, it beats O3 and it's just the best model available on the market today. Now at this point I do have to point out that Google IE presented the new deep search model that is not available as of today. And on some of the benchmarks they didn't even release anything. They were very selective with what they showed and we don't even have direct comparisons. But that might be a good competitor to this as might be future releases, but who knows what the future holds? Right now this smashes, but as you know, it's not even about the benchmarks. It's really about how it performs in practice. It's really about how it feels. It's really about the vibes, as the people say. Okay, so I prepared a few examples here in my early testing and re ran them on the platform today just to make sure that some of these things hold and that the final production models that are shipped now kind of hold up to what my experience previously with them was. And let me Tell you, this thing performs like a charm. So I want to go into some examples, then we're going to talk some more about developer tooling and then we're going to talk about other examples. Okay. But first up, I just want to talk about tone, because this is one of the things that I personally care the most about actually writing with these models. Not writing code, but just writing text. So if I tab over here and I go over to the most basic prompt on planet earth that I, that I often run, write me an email to my boss about the broken coffee machine. Okay. If you run that in here and you read this email, let's just take a second to appreciate how non AI ish this sounds. And you might be familiar with the fact that Claude previously already has been kind of crowned by many the king of tone. Many people use Claude just because they like the tone so much. Okay. Opus 4 kind of trumps that. I would say like, honestly, like. Okay, just have a look. This does not sound like AI, but you be the judge. That's just my opinion right here. So look at that. Hi boss. I wanted to bring your attention. I wanted to bring to your attention that the office coffee machine stopped working this morning. It's not powering on at all. I've checked that it's properly plugged in and tried different outlets. It's like a human would speak. No. Since many of us rely on it, blah blah, blah, blah, blah. Would you like me to. And then three options. Contact the manufacturer about the warranty, repair options, research replacements, call a local appliance repair service. In the meantime, I've set up the back office. It just reads like a human. There's none. No weird words. It's just, hey, this is the problem. I tried a solution. Here's a few suggested solutions. This just reads like a human. There's no weirdness with it. Okay. And I ran many examples. It just like. And this is not even like prompting for any sort of style. It's just the default model. It's way more human, which is wonderful. Sonnet 4 note is not as good as for Opus 4 at actually this writing tone. This is a unique ability with Opus 4. Okay, what else? I have this little prompt that I actually use with a fine tuned model that I have that I fine tuned on a lot of my video scripts. And it just gives it a little bit of context for how it should behave. Although it's already trained on many examples. And right here I just want to look at the first two sentences and then we can wrap up this section on style, you can see that it sounds great, in my opinion. Okay, so this is a YouTube video intro for the best and worst free AI art generators. And then it just starts out. You know that feeling when you have this incredible image in your head, but you can't draw it to save your life? That was me six months ago, staring at a blank canvas app, frustrated as hell, wondering why my stick figures looked more like abstract disasters than actual people. Then I discovered AI art generators. I don't know about you, but to me, this reads like a human. This just sounds natural, like, I can't help myself. I pulled up the comparison here with GPT 4.5, which I also used to really like for writing. But just looking at this side by side, I'm gonna have a very hard time going back from the Opus 4 model for writing because look at this. You know, when I first discovered AI art, I generally thought I'd found magic. Imagine taking your wildest ideas and seeing them come to life right before your eyes. Nobody speaks like that. I mean, and this is the best model they have for writing. It is really good. But it's still. Still, it has. But look at that. Some of them gave me stunning images that left me speechless. Others, well, they made me question if I was even speaking the right language. And then look at that. So today we're diving deep into the absolute best and just diving deep again. Really, this just doesn't do that. It sounds natural and it sounds great without even any specialty prompting. I think this is kind of really shifting what is perceived as AI text. And yeah, if you write with AI, very, very strongly recommend you give this a shot at least. Okay, what else we got? Well, there's a bunch of changes in the API and there's a bunch of changes to what it can actually do with code. Okay. Obviously, I mean, it led with the software engineering benchmark as kind of one of the big selling points. And even if you're a non dev, this really matters because the ability to create little applications, little scripts, just little functional tools to help you is severely underrated by most people. And the reason why most people that even would have the curiosity and the technical or like the computer usability to kind of make these things happen has been severely hindered by the incompetence of many of these models. That's just the truth. You heard about Vibe coding. You tried to create something, but then it creates it, but it doesn't really work. Like, there's bugs in there and the button doesn't work, and you Kind of have to tinker with it. And sure, you can make it eventually work, and you can make kind of a bad version of something that you would need to pay $5 a month for, $10 a month for, but that's just not worth it for most people. I think, here, for the first time, even beyond O3, even beyond Gemini 2.5 Pro, I just have this feeling that that changed. And I have a few examples here. I didn't run these examples multiple times. Okay. These examples I just ran once, and they just work exactly as expected. Okay. Little games, little dashboards. We'll look at these in a second. Before we do that, I just kind of want to go over this blog post very briefly to show you what changed here. Because what they essentially shipped is they shipped a bunch of developer tools. So not just that the model is really good for developers, as we talked about here. And this is really good at Pokemon now. And it's available in CLAUDE code and all that, which is a completely different beast. We can talk about that later on. But in the API, they shipped Claude Opus 4 and Sonnet 4 with all of these different tools like data analysis. So it cannot just write code, it can also execute code through the API. And these are the things that made O3 so powerful. If you're not familiar, OpenAI shipped O3 a while back, and it just blew people away because it had all of these tools, it could write code, execute code, it could generate images. Now, which is actually not that relevant. That's something you don't have in here. But the most essential thing is that it can actually solve these math problems. It can do data analysis by itself when it considers it worth it. The thinking models. And now I'm going to get to my favorite part. They change two things in here. Okay, so in Claude code, which is essentially a command line interface for claude, so you run it in your terminal like this, they change the length that these tasks can run at. Okay. And this video is not focused on that, but I ran a few projects and tried to build a few things. Before, it was like one to five minutes. Now it routinely runs for like 15, 20 minutes. And in the keynote today, they stated it can run for up to seven hours through the API if you let it. Okay, so we literally went from ChatGPT two years ago, solving problems that might take you, I don't know, 10 minutes to do by hand. And it did it instantly. Right? Like in maybe like 10 seconds. Amazing. Then we moved to these thinking models, which sort of thought for a minute or Two and solved harder problems. They could do math, they could code things that were unthinkable before all of a sudden swebench, they were performing really highly and it was like, wow, these are becoming really useful for real world tasks and real world problems and hard problems, not just for inspiration or as assistant or a copilot. And they could save you tens of minutes. Then deep research came around and like that was the mind blow if you follow the channel. I praise the deep research functionalities across all apps because that was like hours saved in some cases, maybe even dozens of hours depending on your tech literacy scale skills. But with this, if the agent runs for seven damn hours, that's not saving you hours, that's saving you dozens, maybe even hundreds of hours. And there was this interesting point in the keynote which I do recommend you check out from Anthropic where the CEO was asked, hey, what do you think? When is the first one billion dollar company gonna be built by just one person? And he actually said 2026. Now if that holds, I don't know. But with agents running for seven hours in May 2025 already, nobody would have predicted that. Nobody thought that we're going to get scores like this this early. Okay. Nobody thought that that would be creating plans on how to solve Pokemon and these, these complex problems and have, have like a getting unstuck protocol that it just self codes and then follows. Nobody thought that we could like initiate these agents in Claude code, let them run for multiple hours while it problem solves everything it stumbles into by itself. It needs to run code. Cool. It does that. It needs to search the web. Okay, it can do that. It needs access to the YouTube API or to your Slack channels. Well, that's what model context protocol is there for mcp. The kind of universal connector that has now been by the way, if you're not familiar, it's kind of like the HTTP protocol was for the Internet. This is the same thing for agents. So you can just connect anything into it. And it has now been adopted by pretty much everybody. I mean, if you're not aware, Google adopted it this week at I O. OpenAI adopted it this week too, into their APIs too. It's kind of everywhere. Microsoft announced that it's going to be built into Windows mcp. So it's kind of like universal, so you can plug all of these other tools into it. Now the API has web search, it has prompt caching, which we'll talk about next year. All these MCP servers, it can execute code and more okay, so last thing we got to talk about here in the context of this running forever and doing amazing stuff is prompt caching. So if you're not familiar, this is essentially a technique to save money. So when you run the API and you run it for a while, that's the reason that this hasn't been able to work. Like, most agents weren't working for like 50 minutes, they were working for like three minutes, and then they kind of ended. Or for 10 minutes in some cases. Right. Or a bit more. But the problem is it starts getting really expensive because you need to start passing the entire history of the interaction back to the agent. Right? So it needs to remember what it did 40 minutes ago if it's going to work for 40 minutes. And then that just starts stacking up, the list starts getting longer. Right? Prompt caching. What it does is you give it a specific area of context or a specific amount of context, and it remembers it once and then it lives in the cache of the agent and you don't have to keep paying for those tokens. So it's a way to save money and a way to enable longer term workflows. And they extended prompt caching from up until now. Up until now it was five minutes and now it's up to one hour with several other improvements. Insane. Like, these agents will be just running everywhere. Now, this is available through the API today. Okay? So people are going to be building this into stuff. So Punchline, before we look into some of these examples here is that it writes really well, it codes really well, but mainly these agents can not just run for minutes as they have. And by the way, if you're not familiar, all of these vibe coding apps like Cursor and Lovable and all of these others, they're built on Claude's models. They're just clawed wrappers with a bunch of logic and fine tunes and, you know, proprietary data and stuff in the background, but they run on these models. And now the model's got massive upgrades and capabilities and you can run them for cheap, not for five minutes, but for an hour. Game changing things, really. And we'll see the repercussions of this over time. To give you a more concrete feeling, I want to round out this video by actually showing you a few examples. Okay, so we talked about some of these things, like the writing style, and that's really great, but really I want to focus on kind of the coding abilities here that you can immediately experience in the web interface by just prompting something and then seeing it come to life. In the artifacts here. So I ran this for comparison. I'm going to show you the prompts. Okay. They're super simplistic, so anybody can recreate these. And also it's also kind of hard to communicate. Like these just super long prompts in here. And it doesn't even make that big of a difference because these models are just so damn good at figuring out what you might mean and creating, like, to do lists in the background while it thinks that you can kind of just do simple prompts like this. Okay. So I prompted for essentially the same thing that I tested in the Google that was shown off in the Google I O video and that I also tested in O3. O3 didn't do that well with their canvas. This does it super well. Plus it actually animates the different planets, which is amazing. So I can actually go here. I can click Saturn and it should be able to. Yeah, it shows you the details and you can speed it up and whatever. Nice, simple little web app. I think I followed up one time. Did I? Yeah. Show all the planets at once. That's the only follow up prompt I had to do to make it better. Before it looked like this with just one planet at once. And in the first version, I didn't tell it to be 3D, so it just looked like this. But yeah, about, I don't know, 20 words. And you get to this. Okay, Next up, I built a game. Okay. And you might be saying igor, you know, like, game. Who needs a simple, you know, stupid game? I think they make great examples, actually, because they're quite complex. There's a lot of logic there, and they're just great to show off. So let's do exactly that. I started with build a simple 3D RPG. Okay. Boom. I got this. All of a sudden you could move around, you could attack and stuff. All right, let's move on. Add enemies, combat, and a golden shovel as the weapon. I don't know why. Golden shovel, maybe that's a little, you know, like we're in the golden era of AI and like, these tools are the picks and shovels. So maybe that's what that means. But I don't know. I just kind of came up with that. So it works, right? Not bad. Now, how can we make this better? Must be really complicated. Right? Make it so that Q and E make me look around and make it more aesthetic. Wow, I'm such a gifted coder here. Make it more aesthetic. And it came up with this. Nice. And now I can spin around and. Yeah, looking good. Okay, but we can do better than that. No, make it brighter and add more decoration. Okay. It fought for a bunch. I'm doing all of this with Claude for Opus, by the way, with Extended thinking enabled. And yeah, in here, that's exactly what it did. Excellent. Looking good to me. There's more decoration. Look at those chandeliers. We have a simple little game, but we can do better than that. Set Swing Shovel to R. Okay. I just wanted everything on the keyboard, so I did that. Let me extend it a little more. Can I do that? Okay, great. And now let's actually play the game. Let's run around. These enemies are getting the best of me. I can kind of, like, see that all works. And here's the thing, there's no quirks. Defeated. Okay, I need to refresh for it to work. Like, sure. Could this ball be a little higher up? Yes. But, like, it all works. The experience, the quality, the vitality, the enemies, Everything just works as expected. Which, when I first tried this, I was like, that's a little sus. I'm not used to that. I'm used to these things coming up and you're having to bug fix for 20 minutes before you even get a working version. That's just the case with every other model. Not with this one. It kind of just works. And I think, yeah, make the enemies into tacos. So I ran this like a minute before hitting record. So let's have a look at. Actually did that. Okay. I literally did not check this. Ah, okay. Yes, we have the taco enemies. Look at that. Taco number one. They even have eyes. I kind of love it. But you might be saying, okay, Igor, you know, tacos, golden shovels. I'm not sure that's really that practical. Okay, how about something actually convenient, something simple that you might actually need, like a finance tracker. Okay. These dashboards were some of the first things people have been building with Claude 3.5 Sonnet, which even 3.5 Sonnet and 3.7 Sonnet were already some of the fan favorites, but now when it actually builds a dashboard, the damn thing works. And I'm not just saying it kind of works or most of it works. All of it works. Okay? I just said build an interactive finance dashboard for a student that is intuitive yet functional. Include logging, cash flow management, and budgeting functionality. Super simple prompt, lot of room to interpret. That's what these models are really good at. I just give it the goal and that's it. By the way, that's. That would be my prompting tip. We talked about this before. If I reset the site. Okay, I have login management. With the login info here, I sign in. Oops, I must have mistyped demo123. Perfect, we're in. And here's the thing. If you build these apps before, you will know that there's just quirky stuff. Like usually the graphs were a bit off the green line kind of ended out here or the dollar sign wasn't in place, or it look, something looked off. Show me on here. What looks off. And we could rerun this 10 times. It just works. That's what I'm saying. So you can add transactions. Okay, example, whatever amount, 50 date. Look at that. The entire interface. There's not a single quirk here. And that's just something that me using these tools so so much I'm not used to. I'm surprised. I'm kind of like weirded out by it, to be honest. Like, how does this just how does it work? Like, why does it all work? This is not supposed to work. I'm supposed to like follow up with another 10 prompts and bug, fix all the stuff and then it's gonna get to the state. I just one shot at this. To be fair, I two shotted it, I gave it this message and then I told it here, add an extra tab for the budget and make it editable and add visualizations on the homepage with mock data. It did that. So I have my budgeting tab over here. I could publish this to the web if I wanted to share this with you. I will actually do that. I will publish these, put the links into the description below. If you kind of want to, you know, stress test this yourself, see if it works. But yeah, essentially I can change my monthly budget, add a zero. That's the good life. And then, let's see, entertainment, transport. All of that just adds up. Just works. Okay, so to round things out, I built this little application recently. There's going to be a tutorial on the channel soon. Like a step by step thing, including like a GitHub tutorial and stuff. The point is I was building this application purely HTML and it was. You'll hear about it soon. It's very cool. It takes your voice, you can prompt on top of it. It uses the transcription API and for the life of me, I haven't been able to turn that thing into a Chrome extension. It just worked as a web app and I really wanted this as a Chrome extension. Guess what, Claude? Opus one shot at the thing. I just told it, turned it into a Chrome extension. It did it. It works. I don't understand exactly how or why, but the results are there. So this is impressive. You know, if you've been following the channel, it's been a while since I really made a video that is like, wow, this, like, this really changes, like everything. Not just in the software industry, but also for all the apps, the subscriptions app you have. I mean, we could talk about this forever and we will, but you can think of the various, like, online services like Netflix, just spawn these dashboards when you need them on demand. Check it out. Thank you for Claude, for giving me early access to this so I could play around a little more than usual with this. And yeah, go create stuff. Go bright, go cold, go build apps, have fun. And yeah, I hope you'll have the same experience as me where it will surprise you by how reliable it is. That's all I got for today. Hope you have a wonderful day.










