EP 274: 7 things you need to know about GPT-4o and what OpenAI isn’t telling the truth about

This is the Everyday AI show, the Everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business and everyday life.

OpenAI just released its new model GPT4O. The O stands for Omni or Omni model, as OpenAI completely changed everything under the hood with how its base model works. But the O could stand for obscurity because there's so much unknown, so much misinformation out there from random people on the Internet and a lot hidden about what's real and what's not with this new announcement and the new model. And there's one or two small little things that OpenAI just isn't telling us the truth about. So we spent way too much time investigating this new update from OpenAI so you didn't have to waste hours. And today we're giving you the seven things you need to know about the new GPT4O model. What's going on, y'? All? My name is Jordan Wilson. I'm the host of Everyday AI. We do this every dang day. Coming to you live 7:30am Central Standard Time with our livestream podcast and free daily newsletter helping everyday people like you and me learn and leverage generative AI. It's a lot to keep up with so you know if you're listening on the podcast. Thank you so much for your support. We please make sure to leave us a rating. You know, comment, let us know, reach out, check your show notes as well. There's always ways you can reach out to myself. And if you're joining us on the live stream, appreciate having you as always. We got big bogey face here on on YouTube. Thanks for joining in, Michael and Brian and Woozy and Christopher, some of our normal, some new faces love to see it. So before we get into this new model in in seven things that I think you really need to know about it, let's first start as we do every single day, with going over the AI news. And like I said, if you're listening on the podcast or if you are joining us live, make sure to check out those show notes as we're going to put in a lot more information, including our website at your everyday AI dot com. All right, so let's talk about what's going on and what you need to pay attention to in the world of AI news. So an AI robot just gave a graduation speech. Yes. At a US University. So an AI robot named Sophia gave a commencement address at d' Youville University in Buffalo, New York, sharing generic advice and drawing mixed reactions from students and the public. So the AI robot named Sophia Sophia's address focus on common themes in graduation speeches such as embracing lifelong learning and believing in yourself. Some students felt that having a robot as a commencement speaker felt impersonal, especially after experiencing virtual high school graduations due due to the pandemic. The university received backlash for their decision to have a robot speaker, but ultimately stood by their choice to showcase the potential of technology all right, our next piece of AI news. Stability AI is reportedly losing too much money and is looking to sell. So according to a new report from the Information, British AI startup Stability Stability AI is facing financial difficulties and has discussed potential sale options with a buyer. This follows a restructuring process and staff layoffs, along with the resignation a couple months ago of the company's CEO. So according to the report, Stability AI has generated less than $5 million in revenue and lost $30 million in the first quarter of 2024. So I'm not great at math or financials, but that doesn't seem good. Also, reportedly the company owns owes close to a hundred million dollars in outstanding bills to service providers, so that's a lot. But you know, Stability AI may still have potential for success with its AI models for generating audio and video using text prompts, so someone might scoop them up. If you remember my predictions in 2023, I did say one of these companies was going to get acquired by a bigger company, so let's see if that holds true. All right, Last but not least in AI news, the US and China finally met on AI. So US and Chinese officials recently held closed door toss on closed door talks on the risks and management of AI technology, highlighting the tension between the two countries. Both sides express concerns and hopes about the potential of AI, but also acknowledge risks in areas such as surveillance and national security. So there's obviously two very different approaches with AI with these two companies. US officials raised concern about China's misuse of AI, while China rebuked the US for restrictions and pressure in the field of AI. So the talks were the first of its kind after a meeting in November between the country's two presidents. China is advocating for the UN though to take a leading role in global governance of AI, something that could sideline the us. So the US is obviously against that. All right. There's obviously a whole lot more that we didn't have time to cover. That's why we put out a daily newsletter written by me, a human. So make sure if you haven't already, go to your everydayai.com Sign up for that free daily newsletter. We'll have a lot more on that news and more. All right, so let's get straight into it, y'. All. Let's talk about the seven things that you need to know about GPT4O and what OpenAI isn't really telling the truth about. All right, so if you're, if you're joining us live, I'd love to hear your thoughts, get your comments in. We'll probably feature some of our favorite comments in the newsletter today. So if you're joining us live, appreciate it as always. Like Tara from Nashville or Fred from Chicago, Juan from Chicago. Chicago, we're rolling deep today. Uh, like myself, Sari joining us from the uk. Appreciate that. And Joe from Asheville. So get your. Get your questions and comments in, but let's just, let's jump straight into it, y'. All. So we're gonna do a backwards countdown here. So number seven, hardly any of the GPT4O announced features are live yet, and most won't be free. Yes, that is important to know. And also this is as of today. Well, actually as of this morning. Right, so May 16th at 7:30am Central Standard Time. Because here's the thing. Obviously these things change quickly, right? But there's just so much bad information out there. And I think OpenAI was a little ambiguous with, with some of the way that it announced things, you know, and a lot of people are asking, like, my thoughts between, hey, how did you know, what were your thoughts between how OpenAI announced everything versus how Google, you know, announced everything at their IO. I think OpenAI did a great job in their announcement. So don't get me wrong, I'm not here to bash on OpenAI. You know, Google's announcement felt extremely scripted. Like it, it hurt watching it. Whereas Open OpenAI felt very real and natural, which I think is important when you're talking about AI, you know, to not actually sound like a robot. Right. To not sound like that Sophia robot giving a graduation speech at d' youville University. Right. Uh, so so many of these features, though, are not out and they are not going to be free. All right, so let me just go ahead and break this down and if anyone out here has taken our free Prime Prompt Polish PPP course that we update literally multiple times a week, and we're doing that again here in a couple hours. So if you want access, just type in ppp. I'll make sure to send you the link. But there's a lot of misinformation. Okay. Because here's the reality, OpenAI said that GPT4O is going to be free to all users. All right, cool, Great news. It's not right now. All right, so people, people were very confused and I'm actually, I did check this like an hour ago, but I'm going to check it again literally right now. But yeah, so it is still not available to free users yet. However, pretty soon all free users will have access to GPT4O. Okay. Presumably it will be logged in users, because OpenAI did just change this about a month ago where you don't even have to be logged in to use its service. I would guess that you would at least have to have a free account to use the new GPT4O model. All right, so there's a lot of, lot of, lot of people even you know, quote smart on, you know, quote quote unquote AI influencers on the Internet who are putting out the wrong information. Okay? Because here's the thing, everyone's like, oh, you know, you don't, you don't need to have a paid chat GPT account anymore, right? Because there's obviously the free plan that costs $0 and $0.00 and the chat GPT plus plan that costs 20amonth. So everyone's saying, well, hey, if the GPT4O model is the newest and greatest model and it's free, everyone let's cancel our subscriptions. So here's something that I think OpenAI definitely dropped the ball on in their communication, right? That's the, the pros and the cons between, you know, a startup versus having, you know, polished veterans deliver your address. But I think that they dropped the ball here by saying, hey, there's so many of these features that we are demoing today and that really I think were the show stopping features that are not going to be available on the free plan. So just because that people are going to have free access to GPT4O and the O, like I started the show off, it stands for omni or omni model. That doesn't mean you have access to all of the show stopping features, right? So I have a little graph here on the screen. I'm not going to go over it point by point, you know, so if you're on our live stream audience, you can go ahead and read that. But a couple of the things that I want to point out or draw attention to is probably what I would say is the two biggest features. One is this Live AI Assistant or Live AI Agent. People are calling it her, I'm calling it the Live OMNIVISION this is the feature that they demoed in almost all of their demos. But it is when you are talking to the app, presumably just right now on the iPhone, it can see and hear and process and talk to you in real time. Right? So the demo. And we already showed this on the show, but was a student doing math, right, Math homework. And it could see it live, right? So this new live Omni assistant could see it live, talk to it. So the student could say, hey, you know, I'm trying to connect, you know, angle A and angle B. Here is this. Right, Right. So it can see, understand, and talk live. Free users do not have access to that, or at least they reportedly don't. Right. Also, the other big feature I think is the desktop assistant, which is huge. It's actually out. People don't know this. There's a little sneaky way that you can install it. You know, not everyone has access to it right now, but there is a. There's. There's a way you can install it. Maybe. I don't know. Should I. It's. It's one of those random links on the Indian on the Internet live stream audience. Do you guys think I should share that in the. In the newsletter today? Let me know. But the desktop agent will not be available to free users. All right, so I'd say two of the biggest reasons why people would want to use Chat GPT would be those two things, right? This, this live kind of agent or live assistant, you know, that can see, hear, process, and you can communicate with in real time, not available to free users. And the Chat GPT desktop app, Right? Which I think is amazing. So in one click or one keyboard stroke, you can literally share anything on your screen. And talk is essentially an overlay on top of whatever you're working on and say, hey, you know, you can talk, or just click a keyboard command and say, hey, what's this? I need help with this. Help me finish this code. Help me finish this email. Right? So all things you could technically do already in ChatGPT, but it saves you a lot of time. And being. Being able to talk to the assistant is. Is something I guess we didn't have before. So those are y'. All. Those are the two headlining features that changes the future of work. We had an entire episode about that, right? So those are the things that I think people are missing. And they're like, ah, you know, just cancel my Chat GPT subscription. It's like, all right, well, also do that at your own risk, because the last time that OpenAI had a huge rollout like this was in November of 2023. And guess what? Obviously once they released it, their servers crashed. They couldn't keep the service up. So guess what happened? They stopped allowing new paid users. Right? So, hey, if you want to go ahead and cancel your subscription, go ahead. But there's a chance that, well, I would actually find it very likely that this is going to crash once it's rolled out to everyone. And they may not take any more paid users for a couple of weeks or a month or two. So, you know, if you want to cancel, do so at your own risk. All right. Yes, Juan, good question. Right now, the app. And so, so the kind of smartphone AI assistant is only for iPhone right now, and the Mac app is only. Or, sorry, the ChatGPT app right now is only for Mac. Again, that could change. But that was just what OpenAI said in the announcement. And it makes sense. Well, it makes sense and it doesn't, right, because obviously Microsoft, maker of Windows, right, has reportedly invested 10 billion to $13 billion in OpenAI and has a 49 equity stakes. You'd think, oh, OpenAI is going to make it accessible for all Windows devices. Not now. You know, reportedly Open AI is locked in to provide generative AI capabilities with Apple for, you know, Apple's new updates that they'll be announcing at their worldwide developer conference here in about three weeks. So, yeah, at least right now it's going to be Mac only or Apple only. All right, so, yeah, Brian, Brian says no, no canceling here. Brian. Also, Brian's ahead of me. He says it will be out for Windows later this year. All right, Yeah, I can't retain everything, you know, I don't have a 2 million token memory. I read so much, I forget a lot. All right, so let's go on to number six. All right, so number six, you probably haven't seen some of the GPT4O's best features, right? So we just talked about the big ones, right, which is what OpenAI spent so much time on, right? So the new model itself is so much faster. The API is half the cost. It's smarter. Whereas before, they kind of essentially stitched three different modes together of the model, which caused latency. So now this Omni model, essentially, you know, it can hear, see, talk and do all these things in one model with lower latency. Right? So that's huge. You have the, this smart AI assistant, whatever it's going to be called in the desktop app. I'd say those are the three big things. But Some of the best things I don't even think OpenAI really talked about, if I'm being honest, right, Man, I mean, go, go, go read their, you know, research paper slash blog post or whatever. But I mean, some of the capabilities of this are, are wild, right? So again, for POD podcast audience, check out the show notes. Come, come. I mean, you got to see some of these screenshots. But you know, as an example, in their very detailed blog posts, you know, OpenAI gave this example of using Dall E. Dall? E is very much improved, I would say. I was testing it around last night. But you know, in this example, in iterative prompting, much more consistency with Dall? E. So if you want to get consistent images. But first the first image, it had, you know, kind of this typed out message. And then on the next prompt it says, the robot was unhappy with the writing, so he is going to rip the sheet of paper. And the text is still on the sheet of paper that the robot rips. So the, the detail and the continuity and the consistency between images. Pretty wild. Here's another example. And I tried this exact prompt, right? You can go try the prompts if they're, you know, on the base model. This, this is wild, right? So here we have a very decorative kind of journal. And you can, you know, I tried this, you know, I did this exact same prompt and then I said, oh, change everything to rhyme with the word cap, right? And then it did it. But, you know, you almost have this very detailed journal with writing, right? With real words. The words don't always, always make sense. Kind of like me sometimes in the morning, but very impressive other things. I did this one last night Chat GPT. I don't see anyone talking about this. Can now create 3D files, which is pretty wild. I don't know a lot about 3D files. I just know they're like STL files. I don't know. To me, STL means St. Louis, but apparently that's what 3D files are. So I literally said, using advanced data analysis, create a 3D STL file of a simple robot, downloaded that, and then I loaded it into some 3D software, right? And working 3D little 3D model, right? In 30 seconds, literally between hitting the prompt, loading it into a program. You know, you can get a model of 3D working 3D model of anything in 30 seconds, right? I think that's a pretty big capability. Speaking of 3D, here's another one, right? We saw Nvidia, you know, announces at GTC like text to 3D hey, same exact thing going on right here. No one talked about this. But you have 3D object synthesis. Being able to create and render 3D objects on the fly is wild. Being able to download that STL source code, wild. Like y'. All. Like there's so many capabilities that OpenAI didn't even get to. You know, we just saw the, saw the shiny stuff, saw the sexy stuff, you know, the. Oh, here's, here's what this new model is capable of. The latency, it's so fast. Listen to the emotion and the voice, the assistance, the desktop app. But man, the base model itself is so improved. So improved. Question from Douglas here said to create consistent images in the updated Dolly, does one still need to index tag the images as in give them number identifiers? That is the next level question. Doug Douglas. Love it. I haven't tried it yet. In the new model, I tried some just normal natural language consistency images and it did much better. Right. So kind of what Douglas is talking about, you can. A little hack, I did a video on this like six months ago is you can essentially assign or have Chat GPT assign essentially a reference number, right? So Mid Journey has their sref and then you can, you know, use that reference number and change small little things. I haven't tried it like that, so I'll have to do that. But you know, I, I had pretty good results or at least better than normal results. Still not at the level of Mid Journey, but just by using natural language. All right, so let's, let's keep this, let's keep this going and you know, get to our other seven things that we need to know. All right, so let's keep it going. Here we go. So the GPT4O model was actually leaked in quotes weeks before. As the model, I'm also a good GPT2 chatbot. All right, I have a, I have a misspelling there. It should say good. That's how you know I'm human. Right? It's not an everyday AI last minute slide presentation without, without a typo or two. All right, so this was confirmed by multiple members of OpenAI as well as Sam Altman retweeted this, but here we go. So if you don't know what the Chatbot arena is, don't worry, I'll tell you. So the Chatbot arena is by lmsys, so you can go check it out, but essentially it's a place where you can just go, you know, the LMSYS Chatbot arena where you can go bench look at different Benchmarks, what's called ELO scores. So essentially how this works is you can blindly test models, you know, put in any prompt, you know, so it can just be like, hey, you know what's going on? Or tell me a joke about, you know, Chicago in the winter. Or it could be like, code me an entire version of Flappy Bird, right? And then you look at the outputs and you judge which one's better. And then that kind of gives you this ELO score. So you know what we see on the, on the graph here. So OpenAI just essentially, I don't know if it was a leak technically or a silent release, right? But they released essentially GPT4O in the wild way before it came out. All of us, you know, I had a dedicated show. They actually released three different models. More on that here in a second. But it outranked all the other models by far. It wasn't even close in this ELO score. So this head to head matchup, right? And when you vote on something elo, like I said, it's, it's a blind vote. You don't, it, you know, you don't say, oh, this is Claude 3, this is Gemini 1.5. Nope, you just put in an input, you know, you get an output. There's been, I'd actually have to, have to look here. There's been more than a million votes. So it's not like, ah, 10, 10 random people. This is a, a very popular service that's being used. But I mean, the ELO scores for the new model, which was, I'm also a good GPT2 chatbot, were literally almost off the charts. It wasn't even close how much further ahead they were than GPT4, GPT4 Turbo, Gemini 1.5, Claude 3, Opus Llama 3. Right, just testing legit, off the charts. All right, so again, people didn't know that, but a lot of us, myself included, have already been playing, had already been playing with these models for a while. All right, and that brings me up to my next point. Another common misconception, something maybe OpenAI didn't really focus on. They actually flashed it on the screen for about 10 seconds, didn't talk about it. All right, but here's the other thing. There were two other models, quote unquote, leaked on the Chatbot arena that have not in theory been released. All right, so here's another thing. Between the free version of the paid version and everyone's like, oh, well, the, the free version is, is if it's so capable, I don't need all these other things. Well, here's, here's, here's the, the hot take. There's other foundation models coming soon. Literally Open AI flashed that up on the screen, kind of barely recognized it and moved on. So yes, I would expect one of these two other models which would either be I'm a good GPT2 chatbots or GPT2 chatbot. Right? Three different ones. One was confirmed as GPT04, the other two, nothing. What's up with them? Well, I do believe that the paid version of chat GPT plus will be getting an update from one of these two models. Right. Might it be called GPT 4.50? I don't know, you know, and also, is that like too many, Is that like too, like too hard of a naming mechanism? I don't know, it's kind of a mouthful. But might we see a new model? Yes, because literally on the screen, OpenAI at their spring event announcement, they did say foundation models coming soon, quite literally what they said. So that's another thing people aren't realizing. This is not the end all be all, you know, and I don't think we're gonna have to wait, you know, another, you know, six to nine months to see that update coming inside of Chat GBD plus. I do think so whenever the free users get, get Access, you know, OpenAI said that this would all be rolling out in the coming weeks. I see a period of maybe a couple of weeks to maybe a couple of months until they update the, the paid tier, that $20 a month chat GPT plus to one of these other models. They're first gonna, you know, try to get everything going right with server squash bugs because this is a huge release. And then after that, I do believe they will be updating the kind of model for the paid version of Chat GPT plus. Are you still running in circles trying to figure out how to actually grow your business with AI? Maybe your company has been tinkering with large language models for a year or more, but can't really get traction to find ROI on Gen AI. Hey, this is Jordan Wilson, host of this very podcast. Companies like Adobe, Microsoft and Nvidia have partnered with us because they trust our expertise in educating the masses around generative AI to get ahead. And some of the most innovative companies in the country hire us to help with their AI strategy and to train hundreds of their employees on how to use Gen AI. So whether you're looking for ChatGPT training for thousands or just need help building your front end AI strategy, you can partner with us too. Just like some of the biggest companies in the world do. Go to your everydayai.com partner to get in contact with our team. Or you can just click on the partner section of our website. Will help you stop running in those AI circles and help get your team ahead and build a straight path to ROI on Gen AI. Yes, in the API. Great point, Douglas. And in the playground, there's actually two different versions right now of GPT4O. And you know what, that actually brings me up to a good point. I had so like so many good things in here, I couldn't fit them all. Hey, another thing that I wouldn't say OpenAI didn't tell us the truth about this, but something that probably changed under our eyes is the knowledge cutoff, which is actually one of the most important things to keep in mind when using any large language model, right? Is the knowledge cutoff. Because the very first iteration on Monday and Tuesday had a knowledge cut off of October 2023. So not terrible, right? But not that great. Right? But now there's different versions and you can go in the playground, you know, ask the exact same question to different models. I did the same thing. And it looks like the GPT4O that is the default version inside of Chat GPT actually now has a knowledge cutoff of May. So it went back even further because the original GPT4 version had a knowledge cutoff of December 2023. So the knowledge cutoff is getting rolled back, which you might be like, huh? Why? Even for paid users? Yes, right now it is. But again, I think that's another nod to the fact that Chat GPT plus paid users will be getting a much more up to date model. Right? So that's another kind of update that happened under the hood is technically everyone's Chat GPT got a little dumber recently, right? By losing that. What is it that four months in knowledge cut off and getting rolled back even more so from, you know, if you were using the best available model last week, the most up to date information was December 2023. Earlier this week it was October 2023. Now it is May 2023. So now we're, you know, a full year back in the future with the knowledge. However, I'm not as worried about that because one of our other things that no one knows about, it's actually number one is probably going to help with that. So yeah, like I said, here are the other, you know, some of the other models, GPT2 chatbot was out in the wild. What's going to happen with that. We will see. So let's go to some other things that you maybe missed. Well, the UI UX was already updated and it can be a little confusing if you don't know what's going on. But there are some new features kind of tucked into this new user interface and user experience. All right, so first and foremost you do have a completely different layout. It is more, it feels more like a text message. So if you use imessage it really feels like that. Now you have these little text bubbles almost, which we didn't really have before. Not a huge fan of this. Could this be a nod to the to future iMessage integration to get people kind of familiar and comfortable? Because you better believe that a big part I think of OpenAI going into partnership with Apple is they want Apple users who aren't ChatGPT users to feel more comfortable and to be attracted by its model. Right. So I, I do think that's a subtle marketing UI UX nod to look and function a little more in theory like iMessage. Right. One of the most popular messaging platforms in the world. So the UI UX is a little different there. It does have these more bubbles. I don't personally like it, it's a little indented. I don't know, maybe I'm weird and pay too much attention to UI ux. Another thing is your settings are now in the upper right hand corner versus the lower left hand corner. I was actually doing a live 90 minute consult with someone the other day and it literally changed in the middle of the consult and I was trying to switch over from, you know, one of our team chat GPT teams plan to chat GPT plus plan and I'm like where did my settings go? So yeah, now they're in the upper right hand corner and then in the bottom left hand corner. Now it just has the option to invite teammates if you're on the paid plan that teams plan. One other thing, a little thing in the UI UX which is a new feature which I'm a huge fan of, is you now have a drop down mode selector. Okay, so again we don't know if this is going to be available in the free version of GPT4O or if this will only be a paid feature. I assume that it's only going to be a paid feature because right now the options are just GPT4O, GPT4 and GPT 3.5. Presumably GPT 3.5 will be phasing out. So free users in theory would only have access to GPT4O, I think, you know, they might still have access to 3.5. I would assume they're going to get rid of it, but we don't know. But a great new feature for paid users, at least right now you can go use it. So you can run an output as an example in GPT4O, switch down to GPT4, you can run the same model and then you can toggle between the two outputs, left and right, right? So maybe you just want to learn because prompting changes, right? That's another thing people don't understand, you know, in the same way, you know, prompting inside of an AI image generating tool like Mid Journey has changed a lot from version 3 to version 6.2, right? Prompting changes a little bit, you know, when the models become newer, faster, smarter, more capable, they understand, you know, human language a little bit more. So, you know, I think that this is important, especially if you're a, a heavy chat GPT user like myself, to run the same prompt in two different models and then just toggle left and right and look at the differences, right? That's the, I think the best way to learn, you can watch, you know, 10 different, you know, YouTube videos about riding a motorcycle. But if you want to ride a motorcycle, you gotta hop on the harley and go. All right, so number two. Here we go, here we go. Ready? Here's where we got a little fib on our seven things you need to know about GPT4. Oh, they kind of fibbed again about the context window. All right, at least for now, again, this is as of, I don't know, this is as of like midnight last night. So eight hours ago, again, OpenAI reported a128,000 token context window. So if you're not a dork like me, the easiest way to think of that is think of memory, right? Like your smartphone has memory. Once you run out, it's not going to remember anything new. So a context window is essentially 128,000 K token window, let's just call it 96,000 words. All right, so that doesn't sound bad, right? Obviously, you know, it's still super small compared to Claude Opus compared to the new, you know, million, 2 million tokens you get with Gemini 1.5. But you have to use Vertex or their studio for that. It's not available right now in the front facing consumer product, however. That's not right. It's not 128,000 tokens. It's still not right. It's going to forget. Yeah, we tested this. Don't never, never just believe what a company tells you, right? Especially, especially Google. But, you know, none of them. Always test everything out for yourself. There's a big difference between what a company markets and, and advertises and tells you how something works versus you gotta go test it yourself. All right, here is a live. Well, not live. I, I don't do these things live because this would take like 15 minutes of stumbling through and pushing this. But so, so here we go. And I did this in different chats, okay? So what I'm doing, and this is, I think one of the biggest things that people get wrong about using large language models is not understanding a context window. So not understanding tokenization in the context window, because it's going to forget things, right? So that's why when you're using a large language model, things might start off great and you're super happy with the results. And then you keep using it, and then it just gets super dumb all of a sudden. And you're like, yo, like, why is this thing not work? I think I broke this thing. It stinks. No, that's context window. So as an example here, I have a token counter. So for our podcast audience, I'm going to try to explain here. So I said simple things and I did turn memory off, FYI, as you can see in the, in the top there. So I said, my name is Jordan, I'm from Chicago. I like deep dish pizza. My favorite color is Carolina blue. I like the Chicago Bears, but they stink. Hey, maybe not this year. Got Caleb Williams now, all right? And you'll see the number of tokens. We're only at 200 tokens. So I just immediately quiz chat GPT. I asked the questions. It gets it right. It says, your name's Jordan, you're from Chicago, you like deep dish pizza, blah, blah, blah, right? All right, so then I push it. And again, each time I do this, I do this in a fresh chat so it doesn't have memory of anything else. All right? So then essentially I put in a bunch of gibberish. I push the tokens to 30,000, okay? And then I ask again. So again, I give it the information, put in 30,000 tokens of random information, a lot of back and forth conversation. I ask the same questions. What's my name? Where am I from? What kind of pizza do I like? What's my favorite color? Do I like the bears? Chat GPT at 30,000 tokens gets it right. Your name is Jordan, you are from Chicago. You like deep dish Pizza. Your favorite color is Carolina blue. You like the Chicago Bears but think they stink. All right, cool. Who likes deep? Hey, don't. It's. It's too early to fight, Douglas. It's. It's deep dish pizza all day. Not. Not New York. Not New York. Okay, Lisa. Lisa here also with a good comment. Sorry, I'm getting distracted, but she says free model has Chat GPT and temporary chat with an upgrade to Chat GPT plus. Yes, you still have a temporary chat option in the free version as of now. All right, back to this. So. So at 30,000 tokens, it remembers all of these things. So the context window at 30,000, it's confirmed, right? Always test stuff, y'. All. But guess what happens when we push it just a little bit more to 35,000. All right, again, fresh chat. I do all the same information and then I say, what's my name? Where am I from? What kind of pizza do I like? And then it says, based on our conversation, here's what I know. Your name, not mentioned. Where you are from, not mentioned. What kind of pizza you like? Not mentioned. Your favorite color, not mentioned. Do you like the bears? Not mentioned. You haven't shared these details yet. Feel free to provide any of this information you'd like. Y' all at 35, 000 tokens, right? We didn't get to like 122, 125. So does Chat GPT actually have this, you know, improved 128, 000 token memory inside of Chat GBT as of today? No, it does not. So little fib there, right? But it does have it in the API. All right, so if you're using a third party tool or if you are using the API, the playground, etc, it does. I'm sure OpenAI knows this. I've been squawking about it now for like six months because people have a misunderstanding of how the model works. That's a big difference, y'. All. 32,000 tokens is not a ton. That's not a ton. You can go through that in, you know, 10 to 15 minutes of heavy usage. Right? And the biggest thing about using large language models, especially to grow your. Grow your company, using it in your business, integrating it into your daily workflow, building GPTs. Right? All of those things is knowing if it's remembering right. Is it retaining all of this information or is it going to start hallucinating? So you have to understand this in large language models makers out there, can we please, please, please. I don't care if Your contact window is 2 million or 32,000. Get markers, get markers, right? We want to increase trust, we want to increase the explainability, we want to demystify the black box of generative AI. It's very simple to put in a context window, right? Markers. So you know, green, yellow, red, right? So you can scroll up, you know, oh, maybe the bottom 32000 tokens are green. You know, maybe the 30 to 32 are yellow and everything after 32, 000 is red. That's not hard, right? But at least users then know, hey, all of this information I was sharing with Chat GPT earlier, that's very important for my output is now out of the context window. So I know if I'm. Whether I'm writing a blog post or using this to send a pitch to a client, all of that information I was sharing is gone. Because people, sorry, y' all humans were lazy so we're not paying attention to that. So you dump in all this information, all this stuff's going well, so you blindly trust everything that's going on and now all of a sudden it's spitting out, you know, just like, you know, a bunch of generic, vague and maybe just lies. And you're not checking it because when you were checking it earlier, everything was good. All right, so Christopher asking, is there an efficient way to move pre existing chat into chat GPT4.0? So yeah, you can now just toggle. So the toggle that I talked about earlier at any time now, which is great because before you could never switch models. So yes, now you can toggle old chats to new chats or sorry, the GPT4 Turbo models. Now you can go in there, use that new drop down menu and change, change the model. Great question. All right, here is our last thing. Literally no one is talking about this and I think this is huge. Huge. I did a little short five minute video on this the other day. So if you're not reading, reading the newsletter and watching those little videos, I think you should. There was all these rumors, right? Oh, Chat GPT is building a search engine, you know, and we talked about them and we covered them, right? So you know, I don't think this is totally gone. I think it's actually chatgpt low key. Didn't really talk about this, but they completely changed how Browse with Bing works if you are an avid listener or watcher or reader of the show. I've been harsh on Browse with Bing because it didn't really work well. It hasn't worked well up until this Week, Right. It was a little sporadic. It did not consistently use Browse with Bing even when you asked it to. It did not always tell you when it did or did not use Browse with Bing. Right. And if you don't know what Browse with Bing is, it is baked into the GPT4 models, right? So if you ask something about recent events or if you ask something that Chat GPT thinks, oh, this might require recent information, it will essentially browse quickly browse the Internet with Bing to bring in more relevant information outside of the knowledge cut off. Right. So if you're asking, you know, a question about, hey, who's, who's winning in the NBA playoffs in 2024, right. The knowledge cutoff is 2023. So GPT4 is going to query the Internet by using Browse with Bing. It's an amazing feature. However, Browse with Bing historically was terrible. Six months ago I literally told people never use it. Two months ago it got a little better. I think after enough lawsuits, OpenAI started to cite things in their responses and they had a blog post how they are, you know, trying to cite information more, especially when it uses Browse with bing. But before, OpenAI and ChatGPT didn't always tell you when it used Browse with Bing. Sometimes it did and it would give you false information. It might make up articles, make up research. Right. Which is pretty normal if I'm being honest, for Internet connected large language models, that's something that's plagued Google. Copilot is not as bad. I'd say Copilot is actually one of the better ones in terms of not hallucinating on the web. But ChatGPT had a problem with that a couple of months ago, y'. All. It is a legit answers engine. Now Browse with Bing is actually pretty flippin good. I'm very impressed. If you haven't really push the limits of Browse with Bing in the last 48 hours, you are missing out. I think in theory this could spell trouble for Perplexity, right? Obviously Perplexity uses the GPT4 engine or you can use the Claude engine so you can swap it in and out. But y', all, I don't know if I'm going to be using Perplexity as much. I'm still going to use it every day. But I think we have a literal answer engine on our hands in the updated Browse with Bing. It is really good. Let's take a look, y'. All, let's take a look, shall we? Hey, and I'm curious I'm curious if anyone out there has. Has noticed this. Hey Joe, Thanks. Joe said I did a decent explanation of context window. Thank you. Well, you know, I've done it at least live like almost a hundred times in in our free prime prompt polish PPP course. So I think early on I did a terrible job. It was actually like my wife told me, she's like talk about it like the Star wars credit scenes, right? Like it scrolls in, you can see it, you can see it and then you can't. So shout out to my wife actually for helping me with that explanation. All right, but let's look at this number one thing that I think is super important, all right? And no one is literally talking about this. Browse with Bing is actually amazing now. And I think that this is going to change how all of us should be using large language models. So as an example, I gave a general query. I said, use browse with Bing and find me. Recent news from May 2024 about AI announcements from Microsoft, Google, OpenAI, Nvidia, Meta and Amazon. Take your time, go step by step and please double check your work. It searched six sites and I love that they have that up there before. So sometimes it would. You would get a dropdown that said it used browse with Bing. Sometimes it wouldn't. Sometimes, sometimes it would put kind of footnotes or links in each bullet point. Sometimes it wouldn't. Sometimes it would just put the sources at the end. Sometimes those sources or those footnotes were hyperlinked. Sometimes they weren't browse with Bing. If I'm being honest, six months ago was six months ago to nine months ago was a hot mess. I would tell people, do not use is not accurate. You cannot trust it. Two months ago I would have said, ah, it's getting pretty, it's getting pretty good. But you know, you should probably still be using perplexity. But y', all now it is really, really good. It not only tells me at the top the different six sources, but then it also cites them in the content that it spits back. Pretty amazing. All right, let's look at one more thing. So in this example, I was a little more specific. I said the essentially the exact same information, but I said use browse with Bing searching at least 10 different sources. And then at the end I said include information and citations on all of them. And Then guess what? OpenAI and ChatGPT and browse with Bing did it searched 11 sites, y'. All. This is the future. This is the future of the Internet. If I'm Being honest, I don't think enough people know about this. If I was OpenAI, I would have spent at least two or three minutes talking specifically about this. Because not only, you know, not that OpenAI needs to worry about market share from Perplexity. Perplexity is huge. I think Perplexity is going to be taking market share from, from Microsoft, Bing and from Google and their new kind of AI search. But y', all, this is a killer feature. This changes, this changes how we should all be using. You know, I, we teach in our free PPP Pro course about proper ways to prompt pop, proper ways in our new refineq method, proper ways to fetch information from the Internet and how you should call on that information and how you should put it into your context window with this. It's huge. It is huge. Like you are literally combining the best of both worlds. You're combining the best of traditional search, you're combining the best of new AI search from, from things like Perplexity with the most capable GPT4O model, y'. All. This is wild. Hey, you can still use Perplexity like, like Kathy said, I don't have a problem with that. You can still use it. If I'm being honest though, I ran these same prompts side by side probably about 5 to 10 times. It's not a scientific test, y'. All. GPT4O was with Browse with Bing was faster, it was more accurate. It, it pulled information from those sources better, y'. All, I think, I think, you know, some, some smart people over there at OpenAI saw the explosion of Perplexity and they've put a lot of human power behind this and just didn't really talk about it. Right. I do expect there to still be some sort of search announcement, some sort of answers engine announcement. Maybe when that chat GPT plus model gets, does get upgraded at some point kind of off or it gets upgraded from the free GPT4O model, I expect them, they have to be talking about this. This is one of the best features of any large language model out there. It performs very well, very fast, very accurate and hey, at least for some very anecdotal head to head. Oh man, I'm not going to say it hands down beats perplexity, but I think it beats Perplexity, at least in my limited use case of this. So y', all, that's a lot. Chrissy, with a great question here. Do you ever specifically ask it to browse with Bing? Almost always. Almost always. I would say whenever we're starting new new Expert chats. That's kind of what we teach people in Prime Pure on polish. I'd say 95% of our new chats either start with a targeted browse with Bing call or working with a Internet connected GPT to have it go to specific web pages. So that's the downside with browse with Bing. Right now you can't consistently get it to go to certain web pages that you want because it's essentially taking those keywords in your query and it's binging them. But with a an Internet connected GPT like web Reader, like Vox Script, like web Pilot, etc, you can visit specific URLs. So oh that's another thing to mention too, differences between the free version and the paid version. You know, free version you can use GPTs but you cannot make them. So you still have to have that $20 a month chat GPT plus account to make custom versions of GPTs, but you can share them now with all your free users. All right, so that's a lot. I know this episode was a long one. Let's go and quickly recap the seven things you need to know. So if this is the too long didn't read version ready. 7. Hardly any of the GPT4O announced features are live yet and most won't be free. 6. You probably haven't seen some of GPT4O's best features and we'll be sharing about those in the newsletter. 5. The GPT4O model was actually leaked, quote unquote weeks before as I'm also a good GPT2 chatbot. 4. There were actually two other models that were quote unquote leaked in the chatbot arena there that have not in theory been released and we do expect the paid model to be released with one of those. 3. The UI UX was quietly updated with some new features that allow you to switch models. 2. Chat GPT kind of fibbed again about that whole 128k context window. @ least as of today it is still only 32,000 before chat GPT starts to forget things. And that number one, I think ChatGPT actually did build in Answers engine with its under the hood updates to browse with Bing. I think it's amazing. I think you all are amazing for tuning in, for joining us live, growing together. You know what, I'm going to go ahead and try something. I want everyone, if you're live right now, drop a little bit about yourself. Go connect like where are you from? What are you working on? We have such a great community Here of people tuning in live to everyday AI, like people who have met in the comments and started businesses together. So I normally don't do this because I like to keep comments kind of, you know, on, on the topic. But go ahead, drop in. Who, who are like, hey, you made it to the end of the show. And this is, you know, when I'm on my own, I kind of ramble. You know, someone said you can only listen to Jordan on 2x and even then it's still unbearable. But go ahead, drop who you are, where you from, what are you working on, who you trying to connect with in, in the generative AI space. You know, you're probably, if you, if everyone does that right now, you're probably going to make a lot of good connections. All right, so thank you all for tuning in if this was helpful. I hope it is. We spend literally so many countless hours putting together these episodes. So you know the facts, right? Because if we're all using generative AI, especially to grow our companies, grow our careers, you have to know, you have to know the actual accurate information from the misinformation from people who don't know what they're talking about, talking about these things online, you have to be able to sort through the marketing fluff, through the reality of how all of these models work, y'. All. If we're using them to grow our business, someone's got to spend the time to investigate and talk about it. That's what we do if you appreciate what we do. If you're listening on the podcast, please leave us a rating. You know, you can leave leave us a one star if you want and say Jordan rambles on. But if you like it, leave us a five star rating. Also, if you're listening here on LinkedIn, if this was helpful, tag a friend, tag a coworker, repost this. But more than anything, please join us tomorrow and every day for more everyday AI. Thanks, y'.

All. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going for a little more AI magic. Visit youreverydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next.