EP 472: OpenAI’s new GPT-4.5: What’s new and who can benefit the most

This is the Everyday AI show, the Everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business and everyday life.

The AI model releases don't stop. In the past 10 days, we've gotten some groundbreaking large language model updates from grok, out of Xai, from Anthropic with their new Sonnet 3.7, and now OpenAI. So after a lot of waiting, what seems like years, we have OpenAI and chat, GPT's next big step forward with GPT 4.5. But let me tell you something, this one's weird. Not saying in a bad way, it's different. And probably for the first time in a long time, I've spent hours now, at least playing with GPT 4.5, and I'm like, this isn't for me. Again, not in a bad way. I just think that OpenAI's new model and GPT 4.5 is something much different than it's released before. It's not breaking any records. It's not climbing to the top of every single benchmark mark. It's a vibes model. It's to feel more relatable and more relational with the end users, all of us. All right, so I'm excited today to talk about OpenAI's new GPT 4.5, what's new, and who can benefit the most. All right, if you're excited to learn about it, you're in the right place. Welcome. My name is Jordan Wilson and I'm the host of Everyday AI. This thing is for you. It's your daily livestream, podcast and free daily newsletter, helping us all not just learn what's happening in the world of AI, but how we can all actually leverage it, what it means, and how we can use the information to be the smartest person in AI at your company. If that's already you, or if that's what you're looking to do, welcome. We just became best friends. Also, your actual best friend is our website, your everyday AI dot com. Go sign up for our free daily newsletter there. Also, people don't know this. You can go listen to every single podcast episode ever on our website. Go watch every single video. There's like close to 500 now, all sorted by category. So no matter what you want to learn, we have it for you. We've probably had a world's leading expert already come and share their secrets, so make sure you go check that out. All right, so I am excited to Talk today about OpenAI's new model. But before we get started, we're going to start off as we do most days by going over the AI news. So Nvidia's revenue has soared 78% year over year to 39.3 billion in the fiscal fourth quarter ending January 26, fueled by strong demand for for GPUs. So the company's data center products accounted for 35 billion of the total revenue, with half of that coming from cloud service providers like AWS, Google Cloud, Microsoft Azure and Oracle Cloud. So Nvidia's Blackwell GPU, which was launched in December, generated 11 billion in revenue in the first quarter, marking the fastest product ramp in the company's history. So yeah, Nvidia's earnings coming out so pretty pretty interesting here. And CEO Jensen Wong announced the upcoming launch of Blackwell ultra in the second half of 2025, promising a smoother transition compared to the Hopper to Blackwell Shift, which faced production changes due to design changes. Sorry, production challenges due to design changes. So Blackwell Ultra will feature advancements in networking, memory and processors, while Nvidia's next generation Vera Rubin architecture combining CPU and GPU technology is set to debut next year in 2026. So Wong emphasized that Nvidia's manufacturing partner TSMC exceeded expectations in expanding production capacity, helping meet surging demand despite initial hurdles. So Nvidia's revenue from China has dropped by half since US restrictions on chip exports began in 2022, but the company now offers a less advanced processor, the H20, specifically for the Chinese market. All right, next piece of AI news. Meta is looking to compete with ChatGPT in a completely different way. So according to reports, Meta is planning to release a standalone Meta AI app in the second quarter of 2025, according to sources familiar with the subject, marking a pretty big step in CEO Mark Zuckerberg's push to dominate the AI space. So the app will reportedly expand Meta AI beyond its current integration with Facebook, Instagram, Whats and Messenger, allowing users to interact more deeply with the Gen AI assistant. So right now you can obviously just go to Meta AI and use their AI that way. But it looks like Meta is looking to compete More directly with OpenAI as a standalone AI app. So in April 2024, Meta replaced the search feature in its apps with Meta AI. Positioning the Chatbot is a central feature for billions of user users. So the new standalone app will allow for greater personalization, conversational history, organization and integration with Meta's hardware, such as Ray Ban smart glasses, according to Zuckerberg publicly agreed with on Threads. So Meta is also exploring A paid subscription for Meta AI. Interesting, right? A fairly open source model, but you will have to pay to use it. Similar to OpenAI's chat GPT plus and Microsoft Copilot, which could generate revenue through premium features and paid recommendations. So Meta AI currently has 700 million active users. So yeah, pretty, pretty wild there. It should be interesting. And you know, CEO Sam Altman, OpenAI CEO, kind of responded jokingly on Twitter and said, you know, hey, maybe we'll just release a social media app. All right, let's get into it. Let's talk about what's new inside OpenAI's GPT 4.5. And this is part one of two, right? I understand y'. All, Sometimes these shows go way too long and the other day I'm like, oh yeah, there are some updates. We're gonna do a short show and that show ended up being an hour. Whoops, I gotta stop doing that, right? No one wants to listen to me blab when I'm tired and over caffeinated for an hour. Plus, so we're actually gonna be breaking this one down. I'm not gonna be doing any live demos today. Those usually take a lot of time but to put together. So probably in the future when there's at least big new models like this, we're going to break it up into two portions. Just like I always say, hey, we're going to learn and leverage. So today we're going to learn about the model, what's new, who I think it's going to benefit, and then we're going to have a second show probably next week on, you know, the best ways to leverage it, probably do some live demos, some examples, all that good stuff. All right, so what the heck is GPT 4.5? Well, it is the last non chain of thought model from OpenAI. So in the future, Sam Altman has said that future systems are going to be hybrid. So what that means is reportedly GPT5 will be more of a system and you aren't going to necessarily be choosing between these quote unquote old school transformer models like GPT4.0 or GPT 4.5 and reasoning models like O3 and 01. Right? So in the future it said it's going to be more of a hybrid approach and it's going to be a system that you talk to and maybe the system is just going to choose which model is best for your query. Or maybe it's going to use hopefully one of my predictions, one of my AI 2025 predictions, which you should go listen to those shows is moving away even from a mixture of experts and going to a mixture of models. I hope we see that. Right. I hope if in the future, if you have a very advanced query, part of it might use in theory, under the hood a GPT type model and then part of it might use an O model. But it is the last non chain of thought model from OpenAI and it's really expensive on the API side. So right now, just FYI, this is only available to pro users. It's only available to people on that $200 a month plan. Although OpenAI did say that it will be rolling out in the coming weeks to all paid users. So, you know, I, I feel most, most people listening in the show are probably chat GPT plus on the 20amonth plan. So you don't have this yet, but probably, I'm guessing sometime early to mid March, most paid users should have access to GPT 4.5 but it's super expensive on the API. Right? So, so you know, developers or you know, maybe if, if you are a technical person and something at your company runs on the back end on GPT, you know, 4O maybe or 4.0 mini. You're probably not going to be using this if I'm being honest and more on that in a bit. But ultimately I think humans are going to like this, right? I think humans are going to like this. And hey livestream audience, thank you for tuning in. I forgot to shout you guys out, but if you do have a question, let me know. So thanks for Big Bogey and Harvey and Samuel joining on YouTube and Woozy Rogers joining us on LinkedIn. Dr. Harvey Caster doing double time joining us on LinkedIn and YouTube. Love to see it. Stephen, happy Friday to you and Brian and Joe, Michelle, Dr. Scott, everyone. Can't go through everyone, but thank you all for joining live. If you do have questions, try to get them in now. I'll try to answer them either as we go as they pop up. Right, yeah. This is a unprompted, unscripted live stream, the realist thing and artificial intelligence. So you know, get your questions in. I'll try to either tackle them as we go or at the very end. So here's some more details on what you need to know on the new GPT 4.5 model. So like I said, it is 200amonth right now to use on the pro plan. So that's if you're using it on the front end Chatbot. Right. Logging into chat GPT.com it's not going to be there unless you're on that 200amonth pro plan. But it should be rolling out in the coming weeks. It's the first major, major model upgrade in over two years though, so that's important. So we've seen iterations and upgrades over the GPT4 model, right? But it's been more than two years since this base model was actually refreshed, right? Let me tell you what I, what I mean by that. So GPT4 came out back in, gosh, 20, 23, right. But it was kind of refreshed. So then we went to GPT4 Turbo, then we went to GPT4O or Omni, right? So it was this Omni model bringing more modalities. But the base, the engine was still kind of the same in OpenAI. You know, they did some fancy engineering and, you know, tweaked it a little bit, but for the most part it was an old engine that was still running this thing, but it was still the most powerful single use model in the world, right? And when I'm talking about single use, I, I'm meaning non raisin ers. So this is pretty big. It's the first major model upgrade in over two years. But here's the thing, it's built for empathy, it's built for relationships, it's built for intuitive conversations, right? People are saying this is a Vibe model, right? It's not shooting off the charts on every single benchmark. But open AI hopes that when you talk to Chat GPT, you're like, oh, this is very human. Like, right? They're, they're like, oh, you're gonna feel some AGI vibes, some artificial general intelligence, right? But here's I, I started the show by saying this, this is not for us, right? If you were, if you're a power user, if you're following AI every day, like me, right? Depending on the day, I know it changes. You know, I'm spending, who knows, anywhere from three to eight hours a day using large language models for the most part, Chat GPT, I'm in chat GPT all day. This isn't for me. This model is not for me. It's really not. I think it's for everyone else, right? This is for casual users. This is for my mom, right? This is for my mom. This is for companies that maybe did not get on board with AI previously. So it's not just like that because of a vibe, it's a vibe model, right? Oh, it feels good, it feels natural, it feels human, it feels like it understands my emotions, right? Because it's not the best, it's not the fastest, it's not the cheapest. So then it's like, what the heck is this thing? Then it's not the best, it's not the fastest, it's not the cheapest, it's not for power users. Like, what, What, what the heck? OpenAI I really focus this on two things, you know. And again, this model literally just came out. I wasn't part of the early testing group, so I look tired. If you're on the live stream and the coffee's probably a little stronger, but I think probably, if I had to boil this down to two words, it would be reliable and relatable. And again, for me as a power user, I've never had problems with those. Right. I don't run into a lot of hallucinations because I know prompt engineering very well. I know how to make sure and to refine a large model and kind of train it up on a very smaller skill set and to increase the accuracy and decrease the hallucinations. But now out of the box, hallucinations are lower. Now out of the box, it's not going to sound like talking to a robot, right? Maybe that's why for the first time I'm like, ah, this doesn't really seem like for me, it's still probably going to be a model that I use very often. Even though it's not the best, not the fastest, not the cheapest. Right. But I, I will assume that, you know, GPT4.0 won't be around for forever. Right. So I, I do need to also understand that I need to start using this model. I need to get used to it. I need to adjust how I talk to it. I need to adjust my expectations. Right? This is why also, I'm updating our free Prime Prompt polish course. Yeah, I know it's been a few months. Don't worry. We're shooting for a March date. Keep. Keep an eye on the newsletter for that. Right? This isn't for me, but I'm still going to use it, right? It's funny because I think for probably a good 15 years, you know, my friends and co workers have called me a computer. Right? They're like, oh, Jordan's a computer. Yeah, he's not human. Be boop. Be boop. That's why for me, right? I don't know, I don't like. For me, I don't need a relatable chatbot. I don't, I don't like, I don't need to talk to something and be like, oh, this feels human, right? Maybe it's because, you know, my EQ is not off the charts, right? But if you are someone that really cares about feeling heard, about feeling understand or sorry, understood. If you want to feel a relatable relationship with an AI chatbot. Not in a weird way, right? But when I think about things like business, like a business coach, a strategist for your company, for your department, right? A true creative thought partner, GPT 4.5 is going to be much better at those things. Are you still running in circles trying to figure out how to actually grow your business with AI? Maybe your company has been tinkering with large language models for a year or more, but can't really get traction to find ROI on Gen AI. Hey this is Jordan Wilson, host of this very podcast. Companies like Adobe, Microsoft and Nvidia have partnered with us because they trust our expertise in educating the masses around generative AI to get ahead. And some of the most innovative companies in the country hire us to help with their AI strategy and to train hundreds of their employees on how to use Gen AI. So whether you're looking for ChatGPT training for thousands or just need help building your front end AI strategy, you can partner with us too. Just like some of the biggest companies in the world do. Go to your everydayai.com partner to get in contact with our team. Or you can just click on the partner section of our website will help you stop running in those AI circles and help get your team ahead and build a straight path to ROI on Gen AI. Angie says Jordan's an AI agent. Sometimes I wish I was. I think agents don't need sleep and agents don't get tired. Those are two things that I'm both struggling with right now. Nancy, former Everyday AI guest what's up? Nancy says the single reason I couldn't live without the pro subscription of Claude is because I couldn't stand to talk to chat GPT all day. Lol. Yeah, that's a great point, right? Because I've never liked Claude. I know people do because you know, they're like, oh, it spits out more human sounding content and it feels more like I'm talking to a human. Well, this is. I'm not saying that GPT 4.5 is OpenAI's answer to Claude. It's not. But you will get those vibes, right? You'll get those vibes that the output, the written text is going to look and seem much more human. Like it's going to seem like a much less robotic process, both in the output and in the interaction between you and the chatbot. So, yeah, a lot of people are saying, you know, and Nancy is definitely not alone in this, right. That people, a lot of people prefer Claude, who use AI just for content writing and who don't want to necessarily go the extra mile in prompt engineering. And they just want to be able to get more human sounding output out of the gate, out of the box, and they want to be able to have it feel more like the assistant understands you, like the AI chatbot understands you. Right. Which is something I think Claude's been great at. Again, for me, I'm a human or like I'm a human, but I don't know, I feel, I think in bits and bytes, I think in ones and zeros. So I don't necessarily need to feel understood by an AI or anything like that. Right, but that's a great point there. So open. And this, this is interesting, y'. All. So OpenAI says GPT 4.5 is not a frontier model, which is wild to think. Right. And that means that it, it's a model that does not represent a groundbreaking or revolutionary advancement over its predecessors. Right? OpenAI straight up said this, they're like, yeah, this isn't like benchmarking off the charts. This is not, they literally said, this is not a frontier model. Right. Frontier models are, are those large language models that are supposed to be revolutionary. Right. This is not it. This is more of a foundational model. But I think here, what we're actually doing, doing is this is building for the future. I think this is all about the training data. This is about how we're interacting with this model. And OpenAI is obviously collecting all of that. They're not collecting the data that you upload. Right. FYI, people always get that wrong. People are like, oh, anything I upload into ChatGPT, it's, it's like, you know, it's like I'm printing it on the Internet. No, it's not what that is. Turn off, turn off your, your data sharing and then you're not sharing anything. Right. But you always have an opportunity. ChatGPT will ask you, sometimes it'll give you two responses. Which one's better? Right? That's being sent to OpenAI. Right. If you say this is wrong, that's being sent to OpenAI. So what I think is actually happening here is there's a big, large, expensive. They didn't say how many parameters this model is, but apparently it's enormous because The API costs are insanely high, right? I don't know who's going to be using the GPT 4.5 API. I'm going to show you the prices. It doesn't compute, right? Using that much COMPUTE doesn't compute. So this model has to be enormous. But I do think that this is going to be the last enormous model from OpenAI, because I think what this is setting the stage for is to get that data on how users like and interact with the model and also those that don't turn off data sharing, right? And I think this is going to lead for better and smaller distilled models. For like, as an example, when we talk about the GPT5 and, you know, the O4O3 models of the future, I think are just going to be distilled based off of this super big model. So it's expensive. And also this thing maxed out. OpenAI's Compute CEO Sam Altman literally said, yo, we're out of GPUs. Right? At least that's what he said. You know, he said, hey, we can't bring this out to all Chat GPT plus users right now because it'll burn us. He literally said, we're out of compute, we're out of GPUs. Right? Which means this thing is enormous. Like I said, the benchmarking improvements, modest, not meaningful, right? A lot of times when you get a new frontier model, it completely shifts the conversation on benchmarks and you're like, well, this one went through the roof. This is not that. And it's designed for more natural human interaction. And like I said, I think this is laying the foundation for future smaller models. And it more combines the EQ with the iq, right? That emotional intelligence with traditional intelligence. That's what this is. This is a much more human touch. All right, here's what OpenAI said specifically about 4.5. Said we're releasing a research preview. Yeah, this is a research preview, y'. All. Keep that in mind. Our largest and best model for chat. They didn't say our best model, they said our best model for chat. Best model for humans to chat with, right? GPT 4.5 is a step forward in scaling up pre training and post training. By scaling unsupervised learning, GPT 4.5 improves its ability to recognize patterns, draw connections, and generate creative insights without reasoning. Early testing shows that interacting with GPT 4.5 feels more natural and its broader knowledge base, improved ability to follow user intent and greater EQ emotional intelligence makes it useful for tasks like Improving writing, programming, and solving practical problems. We also expect it to hallucinate less. Remember those two words I said I think it's going to be more reliable and more relatable. So who can benefit the most? I told you kind of what's new gave you some of the bullet points. Who can actually benefit the most? Right? Like, when are you going to use this? So I think for more human, like, conversations, it's going to be ideal in the long run for companies to use this for customer support or for you to use this for customer support, right? Maybe you're in customer service and you just copy and paste a bunch of information in here and you're trying to work through tough customer support problems. I think it is great for understanding nuances in human language, right? It's probably going to be pretty soon better than humans at understanding nuances in human communication, which is weird to think about, right? So I think it's ideal for customer support, therapy, education. It has enhanced creativity that I think will help writers, marketers and designers generate creative ideas. And for some, advanced coding and technical abilities will benefit developers and data analysts on everything. Right? This is not going to be something that you're gonna, you know, plug in and, and use to code. I don't think that's what we're gonna see here. Although, interestingly enough, even though the benchmarks did not shoot up, this is pretty interesting. So Cognition Labs, right? So they have Devin, which is an AI programmer, very popular, and they were kind of looking side by side looking at different models for agentic coding evaluations, right? And even though GPT 4.4.5 is not necessarily supposed to be a coding tool, it did very, very well on their evaluation. So as an example, its predecessor, GPT 4.0 got a 49% on this agentic coding evaluation and GPT 4.5 got a 65%, you know, only trailing Sonnet 3.7, which got a 67. So again, it's not going to be used. You know, programmers aren't going to use this, developers aren't going to use this because right now the API costs are high. It's slow, right? Even using it. You know, obviously anytime a model first comes out, it's always going to be slower, but I expect this to be slower in the long run. So it's not, it's not the fastest, it's not the best, it's not the cheapest, but it's very capable, even when it comes to agentic coding. So that's according to cognition. Talk about the emotional intelligence so more natural human like interactions than GPT4O. It's going to be better at reading and responding to emotional cues. And according to OpenAI, it was preferred by users in about 56 to 63% of different use case tests against GPT4O. So. Right. Showing kind of 2 responses side by side. So the majority of the time users prefer this to GPT4.0. So it will, presumably. And in my limited testing so far, this is true. Great at storytelling and generating ideas and just generating written content. Right. Which that's something that you use AI for, which I know a lot of people do. I think there's so many use cases people should be using AI for, but they're not. And they're just like, yo, I need help writing this blog post or I need help writing a paper. Right? And ultimately that's what they're using it for, which I why I think a lot of people flocked to Claude early on and I'm like, nah, like you can do this in ChatGPT. You just got to know how to use it. Right? So I think it's going to become a much better writer, it's going to write more clearly and concisely and also I think it's going to be much stronger in design and creative tasks. This is a good news, y'. All. This is good news. Second straight day that the sun is shining in my face and I had to close the curtain here. Oh, bless up. There's nothing worse than waking up for a live stream in the months of winter and it's just dark outside, right? Ah, sunshine. Right. Maybe I need to go outside and touch grass and then I'll appreciate this more human side of GPT 4.5. All right, let's talk about some of the technical features. So according to OpenAI, it is trained. This was trained with 10 times more computing power than the previous GPT models. Also 128, 000 token context window for deeper conversations. I'm going to be testing that one ASAP, because for years OpenAI has said, and maybe they just didn't differentiate and maybe this is just the API and they didn't say, hey, it's 128000 in the API versus the 32,000 when you're using Chat GPT. So I'm going to be testing this, don't worry. And I'm going to talk about that in our part two of the show. Because for so long, when you're using the chat version, right, the front end chat GPT.com it hasn't had 128,000 token context window. Right. So that means that chat GBT will start to forget things much sooner. So it actually had a 32,000 token context window, which is about 26, 27,000 words of back and forth interaction with chat GBT and then it would start forgetting to forget things. So I'm excited to test that out to see if that is just on the API side or if that's going to be also in the chat window. If that is in the front end chat, that's going to be big. Also improved coding, especially in complex tasks. So again, according to OpenAI, this was pre, pre trained simultaneously in multiple data centers, which I believe will be the first for a model like this. Right. That says something when you know, OpenAI has access to some of the biggest data centers and the most compute in the world, they're like, yo, we can't train this in one place. This is too big. I don't know how big this model is. Right. It's got to be multitudes larger than the original GPT model. Right. If it's costing this much in compute, if it's costing this much via the API, if it's causing OpenAI to run straight up run out of GPUs, it's got to be huge. I don't know. Right. Reportedly, earlier versions of GPT4 were about 1.8 trillion parameters. I don't know. This thing's got to be double that, maybe, maybe more, I don't know. But I. That's not sustainable in the long run. Right. Which is why I think this is actually a foundation for OpenAI to better distill and to make better smaller hybrid models as they switch to that. That kind of setup also can handle tasks involving visual understanding. So I did some tests on this. Vision capabilities, pretty good so far. We're going to do more more on that in our part two show. We're probably going to show some comparisons between GPT4O and GPT 4.5, but out of the Box does very well with visual understanding and being able to see and synthesize information in photos. So yes, this is multimodal, FYI right now it has access to all of the tools. I should have maybe started with that. Right. Because these reasoning models, a lot of them, the O1 series, doesn't have access to all the other tools. Right. Canvas and you know, Dolly and Advanced Data and Chat, GBT search. Right. All these other tools that really make a large language model agentic. Right. Didn't have access so right now you do have the rest of the tools. Although I would like and hope that eventually we will see tasks get GPT 4.5 as well as GPTs. My gosh, open AI. I know there's, you know, a lot, not a lot, but plenty of you all listening because you reach out and let me know, can we update GPTs, please? These poor things, they're just like that. That poor forgotten about child in the corner, right? This is Macaulay Culkin in Home Alone. You know, we're leaving the airport without GPTs. GPTs? Y' all enterprise companies, they hire us and they want to build us GPTs, right? And I'm like, y', all like, I don't know, we might to build you projects Instead because poor GPTs are in the corner and they haven't been updated in forever, right? So hopefully we see the GPT 4.5 model eventually be rolled out to other things like tasks and like GPTs. Here's the thing. Reliability. Let's talk about accuracy and knowledge, because I started the show off by saying a lot of companies didn't get on board with AI because they're like, yo, it lies, it hallucinates. Is GPT 4.5 free of hallucinations? Absolutely not. If you know how to use it, you're probably going to see a great reduction in hallucinations. But according to OpenAI, it knows more and hallucinates less. So. So the hallucination rate has gone down significantly higher. Accuracy and factual questions. But what's important to know? The knowledge cutoff has actually been rolled back. So GPT4.O has a knowledge cut off of June 2024, which is reasonable to work with. This one is October 2023, right? So I'm sure they'll be updating the knowledge cut off in the future. But just know if you're using GPT 4.5 right now in the chat or when you're using it when it rolls out to chat GPT plus users, you should probably in many use cases use our refineq method that we teach in our free Prime Prompt Polish Prompting course. Okay? You need to bring in more accurate and more up to date information for whatever it is you're working on to get started with. Or make sure you go retrieve that by using Chat GPT search. Right? Here's the thing. I'm gonna have to do a dedicated episode just on training data and what this means, right? So people think, oh, that means it knows every single thing and it's 100 accurate and up to date. By October 2023. No one doesn't, right. A lot of these data sets that companies use to train their models, you know, by saying, oh, it cut off in October 2023, well, what happens if that data set is updated once a year? What happens if that data set has some extremely outdated information? You hope that through reinforcement learning with human FE back, you know, a lot of that older information gets kicked off when they're going through and they're, you know, training the model, but not necessarily so. Keep that in mind. The knowledge cut off is rolled back. You need to do a better job. If you are using GPT 4.5, you need to do a better job at making sure it has more accurate, more up to date and relevant up like fresh information. If you are relying on it for accurate up to date outputs, the entire world changes around us every single day. So to work with knowledge, a knowledge cutoff from 2023, you gotta be careful, right? It is computationally demanding. So like we said, it's very limited right now. OpenAI's ability to scale this out to users because of GPTs. Sorry, because of GPUs, also weaker. It does have weaker performance and complex reasoning compared to specialized models. All right, let's talk a little bit about accuracy and knowledge. All right, so this is simple QA, which is actually OpenAI's own benchmark, right? I would really like other people to start using this or something like it, but this is essentially like, is this getting things correct? Right? So simple QA accuracy, where higher is better. This is just, is it factual? Is it getting questions correct? Can it recall information in the right way? So on this GP, some of GPT's previous models or some of OpenAI's previous models. So GPT4O scored a 38 on this, where GPT 4.5, not double, but pretty, pretty close. Got a 62% where even the reasoning models got a 47 and a 15. So if you're wondering what's the point of this model, boil it down to two words. It's relatable and it's reliable. It has a much higher accuracy. And let's, let's be honest, we just sometimes look past large language models and we just assume that it's always accurate and we can always rely on them. That's bad. I don't know why people are trying to take human out of the loop and we expect large language models to always be 100% factual and accurate, right? They're trained off the Internet. Is the Internet 100% factual and 100 accurate. Absolutely not. Right. I read in an article on, I think it was chat GBT from a huge publication last week and it was completely wrong. All their facts were wrong. Right. I'm not gonna name shame them, maybe I should. But a publication we've all heard of every. Everyone out here reads it. I was thinking about like roasting them on Twitter and fact checking it and I'm like, this is all wrong. This is all not correct. Right? But guess what? All this information that people put out on the Internet, sometimes people intentionally put out misinformation, disinformation, sometimes people don't know what they're talking about. But all that goes out on the Internet. Models gobble this up and you hope that humans can pick out, you know, information that's in the training data that's not right versus what's right. Right through reinforcement learning. But much more accurate, almost twice as accurate. And what's, what's pretty interesting for me at least is O3 mini there with a 15 on this simple QA accuracy and GPT4.5 with a 62%. I love O3 mini. It's probably my most used model. Right. Again, I do a good job at making sure I feed it the accurate and relevant information that it needs. And I'm not necessarily always relying on it to go and seek and find the absolute truth on its own, but out of the box. GPT 4.5 According to OpenAI's own internal benchmarks, extremely reliable. And let's talk about hallucination rate, same thing, much lower in this case. Lower is better. So in their test it's only it's a 37 hallucination rate. Now, I want you to keep in mind that doesn't mean it hallucinates 37 of the time in these tests and in these benchmarks, they're hard, they're tricky, they are made to get the model to kind of screw up, right? So a very, very, very low hallucination rate actually for 4.5 with a 37 where O3 mini as an example, 80% and a the GPT4O at 61. So again, these are intentionally very difficult questions that are meant to make models hallucinate. So it's more reliable, it lies less. All right, other benchmarks, again, nothing here is jumping off the page. Many of the major benchmarks, this is not OpenAI's best model, right? It's in some cases it's actually about the same or on par with GPT4.0 or it's just behind O3 mini, which again, that is my workhorse model. I'll probably do. Let me know. Live stream audience, let me know. Yes or no. Should I just do a show where I tell you what models I'm using and for what? It might have to wait a couple of weeks to see how and where I'm using GPT4O. I had some people ask about it recently. I didn't think it was that interesting. But, you know, if it's interesting, let me know. And maybe, I don't know, maybe it will be more interesting now that we have like nine models to choose from. But one thing that I thought was pretty impressive about these benchmarks, so it did score better in the MM mu, which is the multimodal equivalent of the mmlu, and it scored fairly well on the mmmlu, which is the multilingual equivalent of mmlu. So MMLU has historically been one of the, you know, it's one of the benchmarks that we talk about most. I say it's like the acts for AI models. Right. So it did perform well or better than GBT4O in those models pretty significantly. But sweet. Lancer, I love this. So this is an actual test that OpenAI developed. And, you know, other model, they use other models, right? And essentially like when Claude came out, Claude was better and OpenAI said that they're like, yo, Claude does way better at sweetlancer. Right. This is essentially a test where it goes out and performs the type of tasks you would see on like upwork. Right. But this one outperformed the other models by far. It completed 32.6% of tasks, whereas OpenAI 03 mini completed 10.8% and GPT4O completed 23%. So that's interesting. Also, O3 mini, I'm guessing at the time, did not have access to all the same tools. O3 mini does have access to the Internet, which is huge because the other O models do not have access to. To the Internet. All right, here we go. Here we go. The costs, I don't know. You know what? I actually can't wait to talk to companies that are using this on the API, because I'm not sure who is going to use it. It costs $75 per million input tokens and $150 per million output tokens. So expensive. So I guess it's. It's going to be those people that. Those companies that really value a reliable and relatable model. Right? So this is just if you're using it on the back end on the API. Right? So if you're logging into chatgpt.com you don't got to worry about this. Right, But I do. I would assume that when this does roll out to plus users, it's, it's, it's got to be limited. I don't see them rolling out this extremely expensive model that they're probably going to be losing money on. When you look at the API costs, I don't see Chat GPT plus users getting unlimited access to this. I, I would assume that there would have to be some rate limits. So let's go ahead and look at some of the cost comparisons. Ready? So I said $75 per million input, GPT 40250, $2.50. So we went from $2.50 to $75. Yikes. Yikes. 30 times more expensive. Is that right? Did I. I just did that math in my head. Hopefully that's right. And then the output, 15 times more expensive. The output for 1 million tokens for GPT4O, $10. And then on GPT 4.5, 150. Right? And like, everyone was losing their marbles when Claude 3.7 sonnet less than a week ago came out and their API pricing didn't change. Right? And everyone's like, oh, Claude's on it. So expensive. Right? And aside from if you're using it from coding, there's no need to, to ever use Quad Sonnet 3.7 via the API. Now you're looking at GBD 45 and you're like, all right, well, Claude Free 7 Sonic doesn't sound like that bad, right? $3 per million tokens input and 15. 4 million output. So, yes, I mean, we were looking at the quad 3.7 sonnet versus GPD4O, and Claude is like, oh, it's like, okay, well, that's 50% more expensive for output. It. Oh, my gosh. And then GPT 4 or 5 comes out and says, hold my GPU. Right? You won't believe this price. I, I don't believe it. But we'll see. We'll see who uses it. Clearly someone's going to use it. So let's talk about the strategic impact. Like I said, I think this is a base model for future AI development. I think it moves open AI towards integrating soft skills with technical skills. Right? That's like when we talk about, oh, this is a Vibes model, this is an EQ model, right? Where I think previously, which is why I never had a problem with it. I don't need Vibes, I don't need eq. But I think a Lot of people do. I think looking at it even as soft skills. This is a soft skills model, which I think why it's actually a big step forward, but it's a big step forward in areas that we're not used to looking at. Normally we look at big step forwards in, in AI models, in benchmarks, in features, but we're not looking at it in terms of it being more relatable and reliable like a human. So I think that's a big thing. Is this is going to be probably the most human model out there, is going to be the best at certain tasks? No. Is it going to be the most reliable and relatable model? Probably. And I also think that this is indicating a possible limits to continued scaling with the current GPT versus O series architecture. So yeah, next we're going to see this hybrid setup. All right, so that's a wrap, y'. All. Look at that. We didn't go one full hour. Bless up. So we're gonna do a part two next week. Let me know what use cases do you want to see? Let me know in the comments today in the newsletter. So make sure you go sign up to it. You can just reply to the newsletter. Let me know what do you want to see? Do you want to see writing use cases? Do you want to see a, a creative strategist? What do you want to push the boundaries on? So we'll, we'll do this show likely either next week or the week after. I got to look at what we have scheduled. We have some great guests coming up, y'. All. I'm very excited. I know sometimes you know the show. I do a lot of the shows. Sometimes we go through periods where it's a lot of guests, sometimes it's a little bit in between. We have some fantastic guests coming up, but let me know what type of hands on you want to do. We're going to do it live. We're going to do it hands on. Let me know what you want to see. Also go to our website, your everydayai.com Sign up for our free daily newsletter. We're going to be recapping this, but like I said, high level here, GPT 4.5. It's out. It's only out for pro users right now on that 200amonth plan or if you're paying through it via the API, which is crazy expensive. This is not a groundbreaking model by traditional metrics. All right. But I do think it could be a groundbreaking model by just the vibes, by how we feel, by how we interact and think about the AI. All right, a couple questions. Let me see. Douglas was saying how would a mixture of models compare to the idea of a reasoning orchestrator and then transformer agents specialized oh Douglas, you're really trying to push this episode to more than an hour. All right. I I think I covered most of that in the AI predictions show. So say, I'll say go listen to that Douglas. Maybe, maybe I'll leave you a more thoughtful comment on the live stream later and explain that. Yasho Sorry if I got that wrong is asking Jordan would you use 4.5 instead of 4.0? Moving forward, here's the thing. It it's better. 4.5 is better than 4 row, right? It's just not better in the same step that normally a new model would be, right? There's very few metrics or instances where four or five is going to be worse, right? Which is interesting because a lot of the chatter so far around Sonnet 3. 7 is a lot of people are saying it's worse for certain situations than 3. 5. It's still too soon to answer that, but from everything that I've used it for, unless I need Speed out of 4.0which is usually not something I'm looking for, right? I'm. I'm patient enough, but I don't think that I'll be using four oh much. Except you know, in GPTs, right? Except with tasks. But for the most part if I'm looking at a non reasoning model, I'm probably going to be using 4.5. Samuel asking does 4.5 support live voice, canvas, etc. So voice is still powered by 4.0 but you can be in 4 or 5 mode and use voice. I did test that last night. So it's not a new voice model, but 4. 5 still integrates and work with Voice mode. It does also work with Canvas. I did test that last night. I also test the combination of the two so you can be in GPT 4.5, you can use voice mode and it will update in Canvas. So pretty cool. Samsara from YouTube is saying why is Google so bad? They're so bad that no one wants to compare their models against Gemini. I think Google's great if I'm being honest, right? I think their front end Gemini chat really was neglected until about five to six months ago. I think the new Gemini models are fantastic. I think their integration into Google workspace leaves a lot to be desired. I think their AI studio is extremely powerful. But no, I think the Google models, I mean they're top of the charts for many benchmarks including the LM Arena. Yashel with another great question here. Is there a benchmark to measure EQ for AI products? As far as I know, no, because I was researching the same thing. So yeah, that should be interesting. How can you benchmark these soft skills? I don't know if there's going to be one that's developed. I would assume after this model there will be one that developed. Right now there isn't one. Douglas asking are you going to look for a PPP update that has transformer model and reasoning model for the different methodologies? Great, great question Douglas. So the the PPP and it's still going to be free. The updated PPP is still going to be based on the GPT infrastructure and the PPP Pro also free will go over prompting for reasoners as well as some other advanced features all right, we got through most of the questions y'. All. Thank you for tuning in. I hope this was helpful. Let me know in the comments. Please share this with your friends if this was helpful. You know I like our team spends a lot of time putting this together. We want you to be the smartest person in AI at your company. So if this was helpful, please let me know and let others know as well. Share this and go to your everydayai.com thanks for tuning in y'. All. We'll see you tomorrow and every day for more Everyday AI. Thanks y'. All.

And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going for a little more AI magic. Visit your everydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.