AI News: We're One Step Closer To AGI This Week!

Matt Wolfe covers OpenAI's five-level AGI roadmap and a reasoning project called Strawberry aimed at autonomous web research. Claude launches on Android, Mistral releases a 12B model for on-device use, and GPT-4o mini arrives with 128k context windows. Google, Meta, and Amazon all pushed new AI tools this week.
Questions this video answers
July 19, 2024
128,000 tokens (input); output supports up to 16,000 tokens.
Up to 256,000 tokens (input).
12 billion parameters; 128,000 token context window.
Chapters
Here's the AI news that you might have missed this week.
Starting with the fact that OpenAI mapped out their five levels towards the progress of AGI. Here's a quick breakdown of those five levels. So level one, they say, would be chatbots and AI with conversational language. That's essentially what we're getting right now out of ChatGPT, Claude Llama, three, things like that. Then you have level two, which is Reasoners that can do human level problem solving. They claim they're very, very close. Level two right now. Then it moves on to level three, which is agents or systems that can take actions on our behalf. You know, book flights for us, respond to emails for us, things like that. Then there's level four, which they say is the innovators, AI that can aid in invention. It's actually going to create novel ideas. And then finally you have level five, which is organizations and AI that can do the work of an organization. So basically, we're right here, right now, we're at level one, almost on the level two. We're right on that precipice of level two. And. And OpenAI believes that we'll sort of move through each of these levels on our way to a true AGI. Now, this was actually released on July 11, last week, but it didn't make it into last week's video. But it felt a little extra relevant this week, because this week we got the news that OpenAI has been working on a new reasoning technology, codenamed Strawberry. Now, I've seen a lot of other YouTube videos and a lot of X posts about this with people speculating. A lot of people believe that this was what was originally called QC Star, and they've now rebranded it to Strawberry. Now, this comes from a leaked internal document. It says teams inside of OpenAI are working on Strawberry, according to a copy of a recent internal OpenAI document seen by Reuters. Reuters couldn't ascertain the precise date of the document and they could not establish how close Strawberry is to actually being publicly available. Likely not very close. The aim of Strawberry is to not just generate answers to queries, but to plan ahead enough to navigate the Internet autonomously and reliably to perform what OpenAI terms deep research. The article does claim the Strawberry project was formerly known as Q Star. This exact article here was actually updated after it was published to add this section. It says a different source briefed on the matter said OpenAI has tested AI internally that scored over 90% on a math data set, a benchmark of championship math problems. Now, Reuters couldn't actually figure out if they were referring to the Strawberry project or not, but it kind of sounds like they're probably the same project. Now outside of this little information that we have on it, there's a lot of speculation around what this is, but it sounds like this Strawberry is pretty close to that level two towards AGI that we were just talking about. And at the moment it sounds like the main purpose of this research is for this new model to essentially do research. Among the capabilities OpenAI is aiming Strawberry at is performing long horizon tasks or complex tasks that require a model to plan ahead and perform a series of actions over an extended period of time. OpenAI specifically wants its model to use these capabilities to conduct research by browsing the web autonomously with the assistance of a computer using agent or CUA that can then take actions based on its findings. Again, not much more is known about this and OpenAI has notoriously been kind of hush hush about their upcoming models and usually we don't know much about them until literally the day they make the announcement of them. And while we're on the topic of OpenAI, more people from OpenAI are coming out and talking about some of the questionable practices of OpenAI's business. It came out this week that some whistleblowers are saying that OpenAI illegally keeps employees from talking to government regulators about problems at work and removes their rights to rewards for blowing the whistle. This comes from a letter that was sent to Gary Gensler, the chair of the SEC. OpenAI refutes the claims saying that they have a policy on whistleblowers that protects employees rights to make protected disclosures. Now this isn't the first time that OpenAI's policies and contracts with their employees have been under scrutiny. Several weeks ago it came out that OpenAI was forcing people to sign non disparagement agreements and if they Talked badly about OpenAI, they could lose their vested equity in the company. Well now it sounds like people are coming forward and claiming that if we blow the whistle on anything we think OpenAI is doing that's somewhat suspicious, we can also lose our vested equity and that's not legal. Now the sources are anonymous. OpenAI claims that that's not actually happening, but I have a feeling OpenAI is probably in the process of overhauling a lot of their contracts that get signed by any new employees that join the company due to all this scrutiny. Again, back when most of these people probably signed up for OpenAI, the company wasn't nearly as bigger in the public eye as now that they are as big and in the public eye, a lot of this stuff is kind of starting to come under the microscope. And while we're on the topic of OpenAI, there's some speculation that maybe the Dall? E image model recently got an update. This is a post from my buddy Angry Penguin over on X, where he shows off an image that he created that has pretty legible writing in it. This clearly says evolve all over it. Previously, Dall? E struggled with words. If I go to Dall? E and say, create an image of a robot holding a sign that says please subscribe, I actually get an image that has the words kind of nailing it. So I think Dall? E did make some updates because the text seems to be much more clear than it used to be. And if you're interested in using Dall? E but you don't have a ChatGPT plus account, you can always go to Bing.com Images Create and use Dall? E3 for free over on Bing's website. Which if Dall? E3 did get an update, it appears to have also rolled out here inside of Bing image creator. I mean, two and a half out of four sort of nailed what I was going for. We also got some new demo videos from Sora. We can see this like black and white video showing all sorts of different clips in black and white that actually look pretty dang impressive. These were shared on Matthew Berman's X account. Here's another one that he shared of like ocean crashing and, I don't know, a gas station or motel or something. But yeah, we're getting more demos from Sora, which is just making people more anxious to actually get their hands on it. But right now we do sort of have that itch scratched in the form of Runway Gen 3 and Luma's Dream Machine. We can actually create some pretty good AI generated videos now with those tools. It sort of damped down the excitement for Sora a little bit. But the fact that this can create much longer videos and OpenAI tends to kind of set the bar for almost everything they put out. I'm still excited about it, but I have gotten that need met with some other tools recently. If you're somebody that uses AI at work or you're thinking about using AI at work, you need to check out HubSpot's completely free bundle called 5 Essential Resources for Using ChatGPT at Work. And honestly, if you haven't embraced AI yet, just remember what Nvidia CEO Jensen Huang said. AI will be the most transformative technology of the 21st century. It will affect every industry and aspect of our lives. So if you're not using AI to speed up and improve the quality of your work, well, your competitors probably are. So the link to this totally free resource is down in the description below and trust me, this is something you're going to want to look through. It includes interesting flowcharts on when you should or shouldn't use ChatGPT. There's also a really cool template that you can use with ChatGPT to make sure that any of the content it creates for you follows your brand's voice. You've got an AI generated content refinement checklist to double check the AI's work and ensure that you're putting something out into the world that you really want to be putting out there. There's also a four page checklist that you can easily follow all about adopting AI in the workplace and a super comprehensive PDF guide on how to supercharge your day with ChatGPT. And here's what's really cool about this. If you scroll all the way down to the bottom of this document, they have 100 ways to try ChatGPT today and it's got some really cool prompts to test out things like providing recommendations for improving customer service and support, providing recommendations for improving SEO, helping with email management and organization, and so much more. Again, it is really comprehensive and really helpful. The link to this completely free resource from HubSpot is in the description below. And thank you so much to HubSpot for sponsoring this video. Andrej Karpathy, who previously worked at OpenAI and then recently stepped away, just announced a new venture that he's working on, he said. Excited to share that I'm starting an AI plus education company called Eureka Labs. At Eureka Labs they're building a new kind of school that is AI native. They say that subject matter experts who are deeply passionate, great at teaching, infinitely patient and fluent in all of the world's languages are also very scarce and cannot personally tutor all 8 billion of us on demand. So it sounds like he's creating a sort of online education where the teacher still designs the course materials, but they are supported, leveraged and scaled with an AI teaching assistant who is optimized to help guide the students through them. So this announcement here is really all that we have. He hasn't really talked a whole lot about this more than the announcement, but what I'm sort of imagining is that a teacher with subject matter expertise goes in, creates an entire course on their subject matter, all of that information is then sort of trained in the AI. I don't know if they're going to use, you know, retrieval, augmented generation, or they're going to fine tune the model. I don't know exactly how they're going to do it, but all of the information that the teacher taught is now available inside of the model. So anybody who wants to learn this stuff can then work with a tutor who understands all of the training material and can speak to the student in whatever language they want to learn. In this will massively scale the ability of an individual teacher who can teach the concept once and then let their AI assistant teach it to everybody else who wants to learn that information. Again, I'm just sort of speculating on what this is going to look like. I don't know exactly, but that's sort of what the concept sounds like to me. If you're a fan of Anthropic's Claude and you don't have an iPhone, well, good news. They just released it on Android. It's been on iOS for a couple months now and they just now rolled out an Android version. Personally, I'm still a fan of the Chat GPT app a little bit more than the Anthropic app, just because the conversational voice portion of the ChatGPT app is actually really, really good. When I'm on my computer, I usually use either Claude or Perplexity. When I'm using my phone, I still go to the ChatGPT app. But I also understand most people probably don't want to pay for three separate chat subscriptions. So if you really like the ability to have a voice conversation with an AI, ChatGPT is still the way. If you don't care about that, you just want the best model in your hand. Claude is probably the best and they now have an Android app. And since we're talking about Android phones, Gemini now answers general questions when your Android phone is locked, there's not too much more to share on this story. It is exactly what it sounds like. Google now lets you get answers from Gemini without actually unlocking your device. Also this week, Google announced Google Vids. Vids is an AI powered video creation app that's designed for work and deeply integrated with the Workspace suite you use every day. You can actually find it over at workspace.google.comproducts/vids. Right now it's not available to everybody, they say. We're currently testing this new application with a select group of trusted testers and according to the video on their website, it looks like you give it a prompt like help me create a sales training video. And then it will help create this like slide style video for you. There's a bunch of different styles that you can choose from. And once you pick your style, you can speak out a script, add a voiceover to it, and add stock footage to it to get the perfect sort of layout for your video. And then it creates that sort of slide presentation video for you. And since we're talking about Google and we're talking about video, let's talk about this new feature that YouTube is rolling out called YouTube Music Sound Search. This sounds like a feature that's very similar to Shazam, where you can have it listen to a snippet of music and it will figure out what song it is, but you can also hum the song and it'll be able to figure out what song it was based on your humming. We can see some screenshots that they shared here. They've got a little search box here with a microphone next to it. I'm assuming they click the microphone and then it says play, sing or hum a song. And then it figures out what song that you were trying to find just based on the singing or humming. YouTube's also testing an AI generated conversational radio. It'll let you create a custom radio by describing exactly what they want to hear. This article goes on to say be on the lookout for ask for music any way you like card in your home feed. This will open the chat based UI with a field at the bottom that lets you ask for music. There's been a little bit more controversy this week. The source of training data for various AI models. This article on Proof News here claims that Apple, Nvidia and Anthropic use thousands of swiped YouTube videos to train AI. Basically, here's what's happening with this. There's a company called Eleuther AI, which is an open sourced company that collects a whole bunch of data from everywhere and puts it into what they call the pile. And the pile is this giant data set that companies then use to train their AI models initially so they can just sort of learn how the language works and just get injected with a ton of data to start. Well, this pile is trained on publicly available data. And it turns out that a lot of that publicly available data was transcripts that were copied and pasted straight from YouTube videos. And a lot of YouTubers started to notice there's data in there for people like MKBHD, Mr. Beast, PewDiePie and others. And this site, proofnews.org actually put up a little search engine so that you can see if a video that you created or literally anybody's video is found within the piles data set. Now, I did a search for my own name and no results were found. I don't know whether I should be offended or relieved. At the time the data was scraped, my channel probably just wasn't big enough. Now after all this came out, Apple stepped up to say yes, we've used the pile for some research purposes and some training, but the model that we're using inside of our Apple intelligence is not trained on the pile's data. So that information is not inside of Apple's training set. According to them, Microsoft has a platform called Designer which if you're not familiar with it, it's very similar to Canva. It's a platform to create things like YouTube thumbnails and banner ads and Instagram images and things like that. Well, this Designer platform is now being rolled out into a whole bunch of different Microsoft apps directly where you can use the Copilot sideb over here, ask it to create a specific image in a specific style and it will actually use Microsoft Designer to create that image and allow you to pull it directly inside of your document or your PowerPoint or whatever Microsoft tool that you're using. Here's another example of it being shown off inside of Microsoft PowerPoint where they create some images. With Designer over here, it generates some images and then they just pull that in as the background of the slide. Designer also got a free mobile app on both iOS and Android, so you can easily create and edit images on the go on a mobile device. Now there's a whole bunch of other new features for Designer if you want to dive deeper into it. This is something that you're really interested in. I will make sure it's linked up in the description so you can see all of the updates here. The article is quite long and there are quite a few updates, but it seems like it's got some other pretty cool features like this Restyle feature. You upload an image and it restyles it to a different style of image. Mistral, the French AI company that develops large language models, released a new model called Code Stroll Mamba. This is a model designed for co generation. It is open source and it can handle an input of up to 256,000 tokens which is double what OpenAI currently offers with Chat GPT. That's roughly 192,000 words between the amount of text inputted and the amount of text outputted this is a 7 billion parameter model and offers a fast response time even with longer input text. So if you're a coder and you're looking to try another large language model to see if it outperforms the other models you've tried, maybe code Stroll Mamba is a choice to try out. Amazon started rolling out an AI shopping assistant called Rufus, which apparently answers questions about shopping and also politics. Rufus is essentially a chatbot, just like chatgpt, but it's built directly inside of the Amazon app and it's trained on the data that's in Amazon. So you can ask what are the best lawn games for kids birthday parties? And it will suggest lawn games as well as where to find them and buy them on Amazon. This Verge article also tested some other questions and got it to answer questions about the candidates for the 2024 election. I've got more bad news. If you're in the eu, it sounds like Meta is not going to be offering their multimodal models and in the European Union they will be offering their normal text input output models like llama, but you're probably not going to be able to create AI images, AI videos and anything other than more text if you're in the EU due to the EU's, I guess, unclear policies. They say here we will release a multimodal LLAMA model over the coming months, but not in the EU due to the unpredictable nature of the European regulatory environment. Says here that Meta's issue isn't with the still being finalized AI act, but rather with how it can train models using data from European customers While complying with GDPR, the EU's existing data protection law. The United Kingdom has nearly identical laws to gdpr, but Meta says it isn't seeing the same level of regulatory uncertainty and plans to launch its new model for the UK users. Here's something that I came across on X from Johannes Stelzer. I just thought it was really cool. They hooked up a little bit MIDI device to their computer and they can turn the knobs to change different aspects of the images. They appear to be using stable diffusion here and then using these knobs to change different elements within stable diffusion, different sort of parameters and I just thought it looked really cool and I wanted to share it. And they also put the code for it up on GitHub. So if you want to play around with something like this and hook up SDXL to a MIDI device, well, that's available for you to do. Here's another article that I came across that I couldn't find a whole lot on I just thought it looked cool is from Gizmo China. Turn your selfie into a printable 3D character with Tencent AI powered app. So apparently this is an app where you can upload a selfie and it will generate a 3D model based on that one selfie that is so good that you can 3D print it now. I actually did some digging to try to find more info about what they're doing here and this was literally the only article I can find about it. But as I learned more about it, I do have a 3D printer. I do love AI. This is something I will be playing with if I can get my hands on it. And here's something interesting. AI systems achieve a 96% accuracy in determining the sex from dental X rays. So they basically trained an AI model on a whole bunch of dental images and then when they ran new dental images through it, it was able to determine the sex of whose teeth those were at a rate of 96% accuracy. And the ones that it wasn't accurate on that was mostly children. The article claims that it's less accurate if you're six or under or basically haven't lost your teeth yet. Now the main use case for something like this would be in forensics. If they find, you know, skeletal remains or something, they can actually identify the sex of the skeletal remains. But I just thought it was fascinating so I thought I'd share with you. So I started recording that video while I was in San Diego still and well, now I'm on vacation in Colorado and a few more pieces of news came out that I wanted to make sure got shared in Friday's news video, including the fact that OpenAI just launched a new model today on Thursday, the day I record this called GPT4O mini. With pretty much every large language model creator out there creating models that are smaller, designed to be more cost efficient and faster. OpenAI needed to create a language model to compete, so this new GPT4OH is replacing the old GPT 3.5. Not quite as powerful as the full on GPT4O, but it is faster and smarter than the previous GPT 3.5. We can see that right now. Today GPT4O mini supports text and vision in the API with support for text, image, video and audio inputs and outputs in the Future. It's got 128,000 token context window, so you should still be able to put large amounts of text as your input. However, the output only supports 16,000 tokens. We can See this comparison here of model evaluation scores with GPT4O in pink being the best model and it pretty much performs the best across the board here in Every test with GPT4O mini, this new model that was just released performing second best across pretty much all of these benchmarks here. Now keep in mind this is comparing it to these other companies smaller models. It almost kind of feels unfair to be putting GPT4O in here compared against, you know, Claude Haiku and Gemini Flash, which is both of those platforms smaller models. While GPT4O is OpenAI's current state of the art model. But nonetheless we can see how this new mini version of GPT4.0 outperforms all the other mini models that are out there. If we log into our ChatGPT account here up in the top left corner where you select the model, you can see that we now have access to 404-H-H mini and the Legacy GPT4. Now at the time of this recording when I try to not log in and just use the free version, it's still claiming it's using Chat GPT 3.5, although it does say here in Chat GPT Free plus and team users will be able to use GPT 4o mini starting today. In other large language model news, Nvidia and Mistral teamed up to create Mistral Nemo. This is a 12 billion parameter model and it also has 128,000 tokens, just like the new GPT4O mini model. Now what's cool about this model is it's actually designed to be run on device. We can see here it says this model's efficiency and local deployment capabilities could attract businesses, operating environments with limited Internet connectivity or those with stringent data privacy requirements. They do go on to say that it's more designed for laptops and desktop PCs than smartphones. So companies that want to run a really, really powerful large language model with a large context window that can take a lot of input and a lot of output text and maybe concerned about privacy or not have Internet access. Well now they have a model that they can use that's going to provide pretty much everything you're going to need. It says the model is immediately available and we have a link here with a downloadable version promised in the near future. So you can actually try this model out over on Nvidia's website. If we come over to build.Nvidia.com explore discover, click on Reasoning. Over on the left side we can see fresh off the Press, Mistral Nemo 12b instruct if we click in here, we get a chat window where we can actually play around with this model if we want to. Again, this is a cloud version where you can just sort of play around with it, but a desktop version is coming soon. And finally, if you're planning on watching the Summer Olympics this year, it looks like Google's AI is going to be everywhere. Google is apparently the official AI sponsor for Team USA and claim that they're going to have ads all over for all of the various Google AI products. So if you haven't heard enough about AI lately on tv, well, watching the Olympics, you're gonna see a lot of it. Anyway, that's all I got for you today. Again, I record these videos on Thursday. In this case, some of it was recorded on Wednesday, some of it was recorded on Thursday. So if there was any news that came out late Thursday evening or on Friday, it didn't make this video. But it will be in next week's news video. While I'm here on vacation, I'm sort of slowing down on putting new videos out, but I am going to publish my Friday news videos on schedule, just like I always do, just less other videos during the week. This week, if you like this video and you want to stay looped in on all the latest AI news, the coolest AI tools, interesting AI research, and, you know, some of my own commentary and opinions around it, make sure you like this video and subscribe to this channel. It really helps my channel grow. It will also ensure that you see more videos like this one inside your YouTube feed. And if you haven't already, make sure to check out FutureTools IE where I curate all of the coolest AI tools I come across. I keep the AI news page up to date on pretty much a daily basis and we've got a free newsletter where you can get all of the coolest AI tools and most interesting AI news delivered directly to your email inbox. You can find it all over at FutureTools IO completely free. Thank you so much for tuning into this video. I really appreciate you. Thank you so much to HubSpot for sponsoring this one. I have a feeling that AI news is really going to start heating up again real soon. There's a lot of cool things in the works that I've sort of been getting some sneak peeks of and I'm excited to share what's on the way. So make sure you're subscribed, make sure you're tuning into these videos. I really appreciate you. Thanks so much for nerding out with me. I'll see you in the next video. Bye. Bye.
More from Matt

AI News: Dots, GPT-6.1 Sol, Sonnet 5.5, Gemini 4, and everything you need to know









