AI News: The Most Insane Week So Far This Year!

Matt Wolfe reviews four major AI models—Claude Fable 5.1, Gemini 3.8 Flash, Meta's Muse Spark 1.3, and GPT-6/Astra—testing them against each other with a custom game generation benchmark. He questions whether industry benchmarks are actually reliable, and covers product launches from Runway, Minimax, and others, plus Nvidia's acquisition of Hugging Face and NYC's K-8 AI ban.
Chapters
This week was absolutely insane. I know most weeks I talk about, hey, there's a lot of news this week. This week there was a lot of really, really big news. Huge model releases, new product updates, lots of stuff to talk about. I don't wanna waste your time. Let's dive right in. We actually got 4 brand new state-of-the-art models from 4 big foundation labs. We got Claude Fable 5.1. We got Gemini 3.8 Flash. We got Muse Spark 1.3 out of Meta. And of course, we've got GPT-6. All huge releases. I actually already made videos about most of these new models. This video here, the most overhyped and underhyped new models, I really dig into Fable 5.1 and Gemini 3.8 Flash. And then this video, GPT-6 Astra is finally here, obviously digs into GPT-6 Astra. I made 2 additional videos this week to talk about those 3 different models, because if I tried to deep dive on every single new model that came out in this video, it would be like an hour and a half long video. So I broke them out into separate videos this week. However, the value proposition of this channel is that you really only need to watch one video a week to get a breakdown of all of the AI news. So I am going to give you the quick TL;DR of these 4 new models. So let's do it in the order that they came out. First, we got Claude Fable 5.1 and Mythos 5.1, Which Mythos is only available to like cybersecurity testers and stuff. When this model came out, it pretty much crushed everything else on the benchmarks. Scientific research, 52.6 over Sol's 22.4, Opus's 29, Fable's 24.7. Terminal bench, 55.8%, beating out everything else. On the day it came out, it was by far the best model ever. Some interesting notes about it. When it comes to price, they claim Fable 5.1 will cost an estimated 25% less than Fable 5 for typical workloads. However, if we look at Artificial Analysis here, they actually do a benchmark test for cost per task, and Fable 5.1 actually came in as the most expensive model per task at $3.69 per task, where Fable, the one that supposedly 5.1 is 25% cheaper than, comes in at $3.14 per task. Supposedly this model will also refuse requests less often, It says we've improved our safeguards to reduce false positives, now blocking 60% fewer false positives than before. On BUCyBench, Fable 5.1 came in second place, but it cost $4.35 to generate this SVG image. So it is a really good model, but it is really expensive. It also took 18 minutes to generate this one SVG here. I also prompted all of these new models to do a clone of Megabonk, as I've done in past videos. just to see what sort of design aesthetic it gives these video games. But I'm gonna show those after I've talked about all 4 models so we can compare 'em side by side. I also have like a little bit of a point I wanna prove about something, and it will make more sense if I put 'em all side by side. Claude Fable 5.1, when it came out, the new best of the best, new state of the art. In fact, if we look at artificial analysis, even after the rest of these new models came out throughout the week, Fable 5.1 still leads the artificial analysis benchmark. This has for the longest time been One of my favorite benchmarks to look at because it's sort of like a combined benchmark where it takes a whole bunch of other benchmarks, puts different weights on them, and then tries to find like the objectively smartest model. But I do have some new issues with this benchmark that I didn't have before, which I'll get to later as well. But according to them, it is the new objectively smartest model, but also the most expensive model to use. Now the next model to come out this week was Gemini 3.8 Flash. This is a new Google model, and it. It's designed to be pretty inexpensive and really, really fast, but still up there with the state-of-the-art models. So if we take a look at the benchmarks here, Gemini 3.8 Flash is pretty inexpensive, $0.75 per million token input, $3.75 per million output. When you compare that to Opus, they're $5 per million input and $25 per million output. And Fable is actually double that. So Fable's $10 per million input and $50 per million output, I believe. So way, way, way cheap. Compared to the most state-of-the-art models. However, this model is really good at coding. This DeepSuite benchmark is a benchmark that people look at because it's got a pretty good correlation between the benchmark score and how good these models actually feel when you're using them to code. Gemini 3.8 Flash, 73.7%, where the previous state-of-the-art best model on DeepSuite was Claude Opus 5, which got a 74%, a point 3% difference at a giant cost savings. Now this model is really good in a whole bunch of these other benchmarks here, but where I've noticed it being the best is actually in coding specifically. It is fast, it is pretty inexpensive comparatively, and it's like just as good as some of the best coding models we've seen. Taking a look at the DeepSwee page here, it actually puts Gemini 3.8 Flash on top, even above Opus 5. Now they're both showing 74%, but the average cost per task here is $2.36 for Gemini 3.8 Flash and $11.84 for Opus 5. And then Claude Fable is at 70%. Claude Fable, when that came out, everybody was blown away by how good of a model that was. That was like the best model anyone has ever seen. Massive, massive leap. And now we're getting a model that outperforms that, where the average cost is $21.63 for Fable 5 at $2.36. for Gemini 3.8 Flash. So as far as like cost-to-value ratio, this Gemini 3.8 Flash is like a really good value here, especially for coding. Jumping back to artificial analysis here, you can see Gemini 3.8 Flash is here, 11th place. But again, this takes in a whole bunch of different benchmarks into account. But when we scroll down to the cost per task, Gemini 3.8 Flash is way down here at $0.58 per task. If you remember, Fable 5 is up here at $3.14 and $3.69 for 5.1. So again, cost to value ratio, huge value in Gemini right now. Taking a look at BuseyBench, this one came in a tie for third. It's a little bit wonky, like it tries to make this really hectic, crazy image with crazy hair and stuff. But Fable 5.1 cost me almost $5. This one cost me a little over 9 cents. Fable 5.1 took 18 minutes. This one took a minute and 32 seconds. Another recent update is from Artlist, and they just launched a new feature called AI Flows. This is supposed to save you a ton of time if you're frequently using AI to make content. So basically Flows gives you this node-based visual canvas where you can connect different image, video, and voiceover models together into one reusable workflow. So instead of rebuilding the same process every time you start a project, you just build it once and then next time you need it, you can swap out your inputs and let it run. You can even generate multiple variations in parallel or start with one of Artlist's pre-built templates and drop your own media into it. And Artlist also just added Seed Dance 2.5 to their platform, which can now generate up to 30 seconds of 1080p video in a single generation. It supports up to 50 reference images with much stronger consistency for keeping the same character, product, or location across an entire scene. AI Flows is live now and included with Artlist Unlimited, so try it out at the link in the description box. And thanks so much to Artlist for supporting my channel and sponsoring this portion of today's video. So next up this week, after Gemini 3.8 Flash, we got Muse Spark out of Meta. And this one, the Benchmarks confuse me. We can look at DeepSuite here, which is one of the evaluations that I really, really like to see how good at coding this is. And this is showing a 75.4, which would make it the very, very top. Now, when I look at the DeepSuite leaderboard itself, it doesn't actually list MuseSpark 1.3. We've got 1.2 way down here, but number 1 is 3.8 Flash at 74%. So this one being 75.4, that means it is the new best coding model ever. And this is where when I show you all the comparisons between my Megabonk test, it's not going to make a lot of sense. But these benchmarks are really impressive if you care about the benchmarks. It's actually Muse Spark 1.3, which is really making me question the validity of most of the benchmarks lately. Looking at Muse on artificial analysis, it apparently comes in at 3rd place behind Opus 5 and Fable 5.1. It's coming in ahead of GPT-6. ahead of Gemini 3.8 Flash by a big margin. So this is the other benchmark that I tend to look at a lot and put a lot of value on. And this model coming in ahead of Fable 5, ahead of GPT-6, and just barely below Opus 5 and Fable 5.1 makes me really, really question this benchmark. As far as cost per task, it's pretty much in line with Gemini 3.8 Flash, $0.55 cost per task here. But when we look at BUCyBench, and again, Take these with a grain of salt because this is AI as a judge, so your own visual should be like the real decider here. This one comes in at— let me keep scrolling here, keep scrolling. Is it even on the first page? Yeah, here we go. MuseSpark 1.3 ranks number 20th overall. It took a minute and 4 seconds to generate. There was no cost because right now you can actually use this model for free through OpenRouter. But this is what it generated. And if you're not familiar with SVGs, SVGs are basically images that were Generated with code. So code is telling it where to draw the lines, what colors to use, where to do the shading. It's basically a coding benchmark to see how well these models are at using code to generate an image. So this being the top model on DeepSwee and in 3rd place on Artificial Analysis, and this is the image it generates. And then you compare that to Gemini 3.8 Flash here, which is lower on both of those benchmarks. Fable 5.1 here, which is lower on DeepSwee. It's higher on Artificial Analysis. But lower on DeepSwee, the coding benchmark. Does this model really look like it's a lot better at coding? I mean, don't get me wrong, it's a good model and it's basically free right now, so I can't complain about that. I'm just very confused about the scoring and it's making me question all of these benchmarks like a lot. And then finally, we got GPT-6 this week, or GPT-6 Astra, which hasn't fully rolled out to everybody. It was sort of just given access to like early testers. Maybe by the time you're watching this, more people have access. I'm not sure, but we can see in their announcement GPT-6 Astra is rolling out today to a limited set of organizations, and over the coming days will become available to all ChatGPT Plus Pro Business and Enterprise users. So they're rolling it out, but as of this recording, most people don't have access yet. I was lucky enough to get slight early access and play with it and, you know, benchmark it and do some of my own testing. So I will show those in a minute. But let's take a look at their page here. When I scroll down to the benchmarks, here we are at DeepSuite, 74.1%. So Again, another model coming in lower than what Muse Spark is getting. Muse Spark was over 75%. DeepSwee would have been the number one, but Muse Spark is above this one. When it comes to the Arc AGI benchmark, this one's pretty insane. 5.6 SOL, 7.8%. Arc AGI 3, 99.9%. They've saturated the benchmark. This benchmark is useless now at this point. So some crazy, crazy jumps in its ability to like solve problems and stuff. Again, I made a whole breakdown on GPT-6, which is why I'm kind of brushing over it quickly in this video. But if you remember, DeepSweep, 74.1%. If we look at the DeepSweep webpage, that would put it at number 1, right? That would put it above 3.8 Flash Opus 5 on this specific coding benchmark. However, don't forget, MuseSpark 1.3 scored a 75.4. So even better than GPT-6. However, However, on my BUCY bench images that were generated by code, it's now the first place model. This is what it generated. It took 9 minutes. The price says N/A because I had early access and it wasn't running through the API. But if we look here, the estimated API equivalent cost would've been about $1.94 using the standard API pricing. And again, this one scored lower on the coding benchmark than Spark. Okay, now I wanna show you a comparison between all of the different Megabonk clones that I had all these models create. So first up, this is the version that Fable made. Looks pretty good. You have different characters you can use. The characters actually look pretty good. This looks like a fox and the bad guys look good. You got little like bugs and monsters. I can change the camera angle. It's a good looking game. Pretty impressed. The colors are great. There's some weird wonkiness like with these things flashing when I hover over them, but it looks pretty good overall. I like how when I switch to shotgun, the characters basically like blow up. Up when I hit them. Nothing really to complain about on this one other than the fact that it worked for about 2 hours to build this game, used up all of my usage for the day, and then went into using extra credits and ended up costing me like $120 to generate this game. So yes, it looks good, but $100 plus, and it used all of my usage credits. I'm on the 20x plan for Anthropic, which is $200 a month. It used all of those credits and then started using additional Credits because I told it it can just spend money if it goes over the usage. Looks great, insanely expensive to generate. Next up, this is the version that Gemini 3.8 Flash generated. Megabonk 3D. Let's go ahead and use the fox here, see how this character looks. Doesn't really look like a fox, looks like a little wizard, but this version looks much, much better than the version I got out of Fable 5 when I first built something like this with Fable 5. I don't know the actual cost it used to generate because I actually generated this one using Cursor and it just used my Cursor credits. I didn't go over the credits. It used a very, very small percentage of my Cursor credits. Really no complaints here. All right, now let's check out what Muse 1.3 Spark generated. This is the Mega Pong game that Muse generated. Yeah, I got a cube with a little cylinder and I'm shooting other cubes. This is the model that is scoring number one on DeepSwe right now, and number three on artificial analysis. This is the Mega Bonk clone that it gave me when I put it on the highest setting for Muse 1.3. So you can see why I'm very confused by the DeepSwe rankings. And then finally, here's the version that GPT-6 gave me. We've got a knight, a ranger, and a mage. Let's go ahead and use the mage just because that's probably the closest comparison to the other ones. And I mean, this one to me is probably. Probably the most aesthetically pleasing. Like, I just like the way the character looks. I like the way the little bad guys look that are coming at me. It looks like the most complete real game here. And this one, it generated in like 12 minutes, I think. I prompted it and it generated super quick and it looks great. I mean, look at the little skeleton characters. Look at the little blobs that are chasing me around. There's like bats that actually look like bats. You can tell they're supposed to be bats. And as the game goes on, more and more different types of characters come in. And it just looks good. I mean, it's very, very pleasing on the eyes. So that's why I'm so confused when I look at DeepSuite, like the benchmark designed for coding, having it put the new Muse Spark 1.3 as the best performing model. And same with artificial analysis. It's putting this model above GPT-6, above Gemini 3.8. And I think both of those models gave me both better outputs on BucyBench and when playing around with like my Megabonk test. So yeah. The benchmarks I've relied upon the most, I feel like I can't really trust even those anymore. I don't feel like that's accurate to my experience anymore. I'm curious what you think about that. But again, I made 2 other videos this week that go even deeper on all of these models, one that specifically focuses on Fable and the new Gemini model, and another one that focuses just on GPT-6. I didn't make a separate video about Muse Spark, but I feel like I accurately conveyed my thoughts about it in this video. Anyway, I got more want to talk about. This next one is a super quick one, but one that I'm really, really happy finally exists. If you use the ChatGPT app and you want to connect more than one Google account, you can finally do that. Now this is news that came out last week and somehow I totally missed it. If I open the ChatGPT app here, click on Plugins, and then click into Gmail, I can click Manage and you can see I've got one email connected, but I can connect another account now. I know I'm not the only one that's excited about this. Now Google also rolled out a sort of quality of life feature for Gmail, Docs, and Google Keep. You can now use voice directly inside of those platforms. So pretty much the Gemini audio features that you've had access to in some of the other Gemini-specific apps, you can now use in Gmail, Docs, and Keep. Imagine you can have a conversation with your inbox. I'm a mom of a 3-year-old. Jack is starting pre-K. What do I have to bring for Jack's first day of pre-K? 2 changes of weather-appropriate clothes and a family photo for the classroom tree. I'm a person who thinks out loud. Now I have this part in Gemini where I can brainstorm right inside of Docs. Hey Gemini, help me create a document to help me organize my upcoming block party. I've gathered the details for the end of summer block party scheduled for August 29th, 2026. So it says these new conversational features are rolling out this week, so you may have 'em in your account by the time you see this, but they are for AI Plus, Pro, and Ultra subscribers. So you gotta be on like a paid plan to be using these. We got an update in the world of AI video slash I guess that's not my words. I mean, like the people doing this stuff are actually calling it slop. Minimax rolled out a new video model that can generate a 15-second video in 13 seconds. So it can make a video that is longer than the amount of time it takes to generate that video. So of course, what do you think people did with that? They started making infinite streams where you could just keep on prompting stuff and the video just keeps on going forever because it's generating faster than it's actually playing back. The company Fall created fall.live, or fall.live, never really know how to pronounce that, but it's a new platform for infinite interactive AI live streams. You pick a channel, prompt what happens next, and watch it generate in real time. Peter Levels here created something similar, infiniteslop.ai. 37,000 people were watching Infinite Slop on one of the days, but it's the same kind of idea. People tell what they want to see in the comments And the video just keeps on generating and making new videos. So here's what that looks like on Infinite Slop. You could see what people are prompting and you could see what it's generating and the queue for prompts that are gonna come up. And it just keeps generating videos of slop. It's sloppin' time. Yeah, and there's 75 people watching and over 5,000 have watched today. So yeah, that seems like a pretty good use of your time, I guess. I mean, just because we can, does that really mean we should? Anyway, I said there's a lot this week. There's still quite a bit more I want to talk about, but I will talk about all the rest very rapidly in a rapid fire. Pew pew pew pew pew pew pew. I'm gonna start with one of the cooler things I saw this week, which is the new Atlas model out of WorldLabs. This is really cool because you give it an input image and you tell it a camera path and it will generate an output based on that. So basically using photos, it can sort of figure out the space around those photos. Atlas generates images and videos from one or more images with pixel-perfect camera control. It's got spatial reconstruction It reconstructs real-world scenes from one to dozens of input images. Now, this isn't just generating a video, like this isn't a video generator. This is generating like an environment here. We could see the input image that was given, and then it sort of reconstructs everything based on that one image. In fact, here's another example where it took this one image, and I can actually— I'm manipulating this in real time as I move my mouse around, look at different angles. from just that single image. And if you give it 2 images, you can see that it can combine those 2 images into a single scene that you can move around and manipulate. This one here looks like it's got 1, 2, 3, 4, 5, 6, 7 different inputs to generate this output here. And again, this isn't just a video. This is like something that you can move around in and manipulate and change camera angles on and things like that. Super, super cool. Now this is in early access, so most people don't have access to it yet. I reached out asked about early access so I can play around with it and test it and make another video about it because I thought this was really cool. I love stuff like this. I can imagine, you know, going and taking a whole bunch of pictures inside of your house, putting them into a platform like this and easily remapping the house. Now I know you can already do that with things like Gaussian Splats, but this does it with a lot less photos. It seems something I'm really excited to play with. So again, not a video generator, like an actual environment generator. You can also do really cool like bullet time type effects with it. So if you did want to use it for video, there's some pretty cool implications there as well. Anyway, this is supposed to be a rapid fire and I'm nerding out about this too much. So moving on, the company Runway introduced something called Solaris this week, which appears to let you like manipulate videos in real time. This is another one that's in early access and I don't have access yet, but check out some of these demo examples here. This person takes a selfie here, uses that photo, puts them in a scene, and they're able to drag and drop shoes on their They're able to drag and drop different clothes. Here's a scene inside a room where they're manipulating it and moving things around in the scene. And what's crazy is like, as they move the plants around, you'll notice the shadows change and things like that as well. So it's built on the Gen 4.5 video generation model, which was adapted to understand interaction and respond in real time. Solaris treats user input as conditioning for the next frame, the same way it treats text or images. So the model observes clicks, drags, and other interactions as it generates, using them as signals for what comes next. Again, this is something I probably would have done a deeper dive on if we had access to it, but if you want to check out some of the demo videos and see what this is capable of, all the links from this video are mentioned down in the description. If you're a user of OpenCLaw, they just released a brand new overhauled new version with OpenCLaw 2.0. For me, things like Codex and Cursor have completely replaced OpenCLaw since they have sort sort of like agentic features built in now. So I haven't used OpenCLAW in quite a while, but if you are somebody that's still using OpenCLAW and you've tried the OpenCLAW 2.0 and really, really like it, let me know in the comments because maybe I'll make another deep dive video about OpenCLAW. We got not one but two new transcription models this week, one out of Meta, Muse Voice Transcribe. It does exactly what you think it would do— you speak, it transcribes. These transcription models are getting better and better. This one is really good for streaming I guess for like real-time transcriptions. This one came out on September 1st, and then just 2 days later on September 3rd, Microsoft released MAI Transcribe 2, which is now the fastest, most accurate, and cheapest speech recognition model. So again, another model that does exactly what you'd expect it to— it transcribes your audio into text for you, and they're just getting better and better. This would have been a much bigger story if I hadn't already went off on a big long rant in last week's news video, but Nvidia officially acquired We talked about it last week because there was rumors that it was going to happen. So I really deep dove on the implications of that. But to sum it up, this is basically Nvidia betting on open source. You have companies like Meta and OpenAI and Google all trying to build their own chips so that they don't have to use companies like Nvidia and buy all their compute from them. So Nvidia goes, okay, well, let's really pump some investment into open weight models, the models people are just going to run on their own computers. run locally, the models that are very inexpensive to run. And if the big frontier labs don't need our compute as much anymore, well, then the general consumers and the businesses and the enterprise companies that want to build their own on-premises sort of data centers, they'll buy our compute and use the OpenWeight models. In my mind, that is sort of the play that Nvidia is going for here by acquiring Hugging Face. Hugging Face is like the GitHub for model weights. Whenever new models come out, people load them onto Hugging Face. Hugging Face also is a compute provider. You can go and use the models using Hugging Face's compute. So very interesting dynamic here. But again, this is Nvidia betting that open weight models are going to get bigger and bigger and more popular in the future, and they can sell hardware to the people that need those. But if you want an even deeper dive, again, last week's Friday AI News video dove pretty deep into this. Apparently your ChatGPT conversations could end up in court and they are not protected. So the conversations that you are having with ChatGPT, they're not as private as you think. If you're talking about illegal stuff and you ever get in trouble, your chats are not off limits in court. So just something to keep in mind for the future if you're talking about some weird stuff with your models. The mayor of New York, Mayor Mamdani, made a new AI policy this week, making it so that students in K through 8th grade can't use AI in school. Now, it's not against the rules for kids to use AI, They just can't use it in school. The whole thinking behind this is that kids need to learn fundamentals without using AI before they get access to AI. So in the same way, when you're learning the basics of math like addition, subtraction, multiplication, division, like the basics, you really shouldn't be learning with a calculator. But then once you understand how to do it, then you bring the calculator to the mix so that you can do it easier and faster. That's sort of the thinking here, but there's obviously a lot of mixed opinions on how people are seeing this right now. And finally, I always like to end with tech and gadgets. And the company Dyson— yes, the company that makes the vacuums and the fans— they just made an AI toothbrush. And to be honest, I kind of want one. It's called the Dyson Camera Jet, and it's got a camera and a water jet on it, and it uses AI to accurately shoot water between your teeth and like does the flossing for you. So you're brushing and flossing at the same And it uses AI to like help shoot the water jets in the optimal spots to do the flossing for you. That's my understanding at least. So here's a picture. You've got like a camera sensor thing here. You got your normal toothbrush and it's got a light so the camera can see and then it's shooting the water to do the flossing. And like, if I can knock out both brushing and flossing all in one go and it uses AI to make sure it's doing a good job, like I'm all for that. The one major downside is that it is a $500 Toothbrush. So no, I haven't ordered one yet, but I'm kind of seriously considering it. Would you pay $500 for one of these? Anyway, that's what I got for you today. I know there was a lot this week. All of these model drops are getting sort of exhausting. If you feel exhausted by it, trust me, that's how I feel as well, trying to keep up with it every day. But that's what I do here. That's what I'm trying to do every single week. I am keeping up with all the AI news. I'm drinking from the fire hose. I'm testing the things. I'm reading the articles. I'm talking to the people. I'm, you know, trying to get early access wherever I can and trying to stay as looped in as possible. I'll sort of take on that overwhelm and then make these Friday videos for you so that if you want, you can just watch one video per week and stay completely looped in on everything that's going on in the world of AI. That's my goal with these types of videos. If that's something that interests you, maybe consider liking and subscribing to this channel. That'll make sure videos like this continue to show up in your YouTube feed. I don't think any of the news is slowing down anytime soon. We still have Meta Connect coming up this month. We have an Apple event. OpenAI's Dev Day is still coming up this month. The Made on YouTube event is coming up this month. There's a lot still happening. People call this Techtember because there's so many different like keynotes and things going on this month. I devote pretty much my full-time job's worth of attention to this stuff so that I can try to make it easy and accessible to as many people as possible. And I absolutely love doing it, even though it is overwhelming at times. It's a lot of fun, but it's also a lot to keep up with, but I wouldn't have it any other way. Anyway, thanks so much for hanging out with me. Thanks for having me. hanging out and nerding out with me today. Hopefully you learned something. Hopefully you feel more looped in. And, uh, yeah, I really hope to see you in the next video. I got some really cool ones coming up, so see you there. Thanks again. Bye-bye. I am the Knight of the Round Table. And that's how it happened.
More from Matt

AI News: Dots, GPT-6.1 Sol, Sonnet 5.5, Gemini 4, and everything you need to know









