Ep 271: OpenAI Releases GPT-4o. 12 things you need to know

This is the Everyday AI show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business and everyday life.

OpenAI has just released a new model called GPT4O. So this is actually our second episode of Everyday AI. We normally just do this once a day, but it was a big enough announcement from OpenAI just about an hour ago that we had to come back for a second time today so you can stay up to date. So we're going to tell you not just what this new GPT4 model is, but we're also going to give you quickly 12 things that you absolutely need to know. All right, well, hey, if you're tuning in maybe for the first time ever or for the second time today, my name is Jordan Wilson. I'm the host of Everyday AI. We're a daily live stream podcast and free daily newsletter helping everyday people learn and leverage generative AI to grow their companies and to grow their careers. So, hey, thanks for tuning in if it's your second time, but if it's your very first time, make sure to go to your everydayai.com Sign up for the free daily newsletter. Much later today, right, because we have a lot of news that we're trying to sort through. So earlier today we brought you the AI news that matters for the week. So now let's just dive straight into this new announcement from OpenAI a little bit about what it is and why it definitely matters. All right, so today we're just sticking with the facts and some observations, but tomorrow we're going to have a much more in depth episode full of hot takes. As always, it's hot take Tuesday, so we're you like, you know, we're going to come with it. All right, so here's what you need to know. Well, right, right now the new version GPT4O is what it's called. And if you log into your account right now into your chat GPT account, you may already have access to this new model called GPT4O. All right, so it's pretty, pretty exciting. That was a fast turnaround, pretty quick release. Also, you will need to make sure you select that model. So if you are an avid ChatGPT user such as myself, make sure when you log in that you select the newest model, GPT4O. All right, so here are 12 things that you need to know. So first, the basics. So the new model is called GPT4O, which stands for omni modal omni model. Right. So essentially what that means is the ability to kind of work with it or in reason, in text, video, audio and more. So more on that here in a minute. All right, second thing you need to know, GPT4O will be available to free and paid users, right? I kind of found that interesting. I don't know if now there is as much of a reason to have a paid account. So we'll get into the sum of the differences between what a paid account actually gets you. But a big part of OpenAI's announcement today was really about their desire to make this technology available to all. So pretty big, pretty big kind of thought there. Pretty big move by OpenAI. I'm actually, you know, like I said, this is brand new, so I'm checking this as I even type to see if you have access. So it looks like at least right now you can only access this model if you are on the paid plan. Right now, if you are on a free plan, even without logging in, you can still use the old model GPT 3.5. But it doesn't look like everyone, not even users who aren't logged in at least cannot access this. At least as of Monday afternoon at 2pm Central Standard Time. Things could move quickly. All right, third thing that you need to know about this new GPT4O is that paid users will have 5x the capacity limit as free users. So again, we don't know at least right now, what other differentiators there will be between the free account and paid account. If nothing else, this is huge news. I think for free users to have the ability to use the exact same model as paid users is actually something we haven't really seen out of the big large language model players. So as an example, up until this recent announcement, ChatGPT so OpenAI's model had big difference in the model between free and paid tier. Google with their Gemini 1.5 big difference between the free and the paid tier. Claude 3 big kind of jump between Haiku and Sonnet versus the paid version in Opus. So this is the first large language model that we've seen seen, aside from Meta's Llama 3, which is kind of free and pretty much open source. But aside from that, this is the first kind of big play from a large language model worker that gives free, you know, free and paid users the exact same model and level of access. Again, at least now that's what they said. Maybe there might be future capabilities or, or future features for the paid version of Chat GPT plus plus, but right now it looks like the only Differentiator might just be the limits. So having five times the capacity if you are a paid user. All right, number four. Well, speaking of more things for free users, even free users will soon be able to access the GPT Store, which was previously limited to Chat GPT plus paid users only. So if you don't know anything about, about that. So essentially, chat GPT and OpenAI have what's called a GPT Store, which is a very simple way for people to go and create essentially a custom, pretty, pretty simple version of Chat GPT so you can give it kind of custom, custom instructions, some custom configurations, you can drop in your own documents, things like that. So now all of a sudden you're going to open that up to every single free user out there. So I don't believe you will be able to use this if you're just, you know, in an incognito or not logged in. But OpenAI did say today that even if you are a free user, you will soon have access to the Chat GPT GPT Store. So pretty big news there. And, and I am checking live in real time, y'. All. This is like literally as quickly as we could get a podcast episode out. So it looks like right now I'm checking and even in a free account, because we have multiple paid accounts and multiple free accounts. So I just, just went into a free account and don't have access to the new GPT4O model yet, but we do have access to it, obviously Both on our iOS, so the, the mobile app, as well as obviously in the browser in the paid account. So, yeah, let me know. Did anyone out there, I, I know we're going live here as well, as well as the podcast, but wondering if anyone here live has, has jumped in. Number five, thing that you need to know is, well, GPT4O combines transcription, intelligence and text to speech, essentially all in one mode. So OpenAI kind of went through kind of a historical look at how they've traditionally handled, you know, conversations with an AI, Right. So conversations with a large language model, in a lot of it, you know, there's a lot of things going on, especially if you're using your voice to talk to Chat GPT or if Chat GPT talking back to you, which is the, the read aloud option, has been available for quite some time. But, you know, we're going to leave some demos in our newsletter today, which should be going out here hopefully in an hour or two. But, you know, the ability now to have all of this happen in one instance without a bunch of latency is, is pretty impressive. All right, the sixth thing you need to know, and this is actually, I think maybe the biggest is, is there will be a new desktop assistant that can quote, unquote, hear and see what you're working on. So again, and we're going to talk about this more in our hot take Tuesday tomorrow, but OpenAI did what they said were live demos and they looked pretty live, unlike Google's kind of snafu back from December when they previewed their Gemini model for the first time. And then we kind of came to find out much later that it was all a marketing stunt and none of it was actually live. Today's demo did truly look live and it was confirmed by, you know, at least one or two OpenAI senior staff members that it was live. It wasn't a pre recorded demo and it, you know, I watched it myself live, it looked like it was live. There were a couple of hiccups as well. But the new desktop app I think is huge. There were also some, some videos that, that, that OpenAI put out on their YouTube channel, about 10 or so short videos showing some of the different capabilities. And I like that they do a split screen so you can kind of see what's happening inside of the, the GPT4O interface as well as presumably what is a live recording of the user or users who are interacting with this kind of new desktop assistant. And on the app. The desktop assistant, I think is going to be huge, at least if the way that they demoed it, if that actually comes to fruition, where you can actually have a desktop app, you can be working on something on your computer. An overlay on the screen is what it looked like. But the ChatGPT app would come up, you can click to speak to it and say, hey, look at this on my computer screen. You click one button, it gets what's on your computer screen. Help me solve this problem, help me improve this code, help me finish this email. Right? So pretty cool. You know, it's, it's technically not an AI agent in the, in the form that we thought of it, but this is kind of agent capabilities, right? Like maybe not autonomous agents, but one click agents, right? So think with this desktop app, no matter really what you're working on, being able to instantly have a one click conversation with this new GPT4O and to be able to share with it within what looked like one click kind of what's happening on your screen and for it to be able to help walk you through it, maybe help you, you Know, create a blog, you know, finish a blog post. You know, I think that changes really how we work because before, you know, even people who are great at ChatGPT, you would have to do a lot of things, you know, uploading files, screenshots, documents, etc, and now it seems like this new desktop app, whenever it does or maybe release, is really going to make that experience much more seamless. So if you haven't already gone through the process, whether actually physically working with AIs in your day to day or even in your mind. Right, so, so we're going to have more on that tomorrow, but you're going to most, most people out there, right? And presumably, you know, OpenAI is kind of, kind of the pace car here and everyone else, I'm guessing, will be scrambling to catch up. But you know, if you haven't already come to the conclusion and you know, we, in our 2024 prediction show back in December, we predicted this, that, you know, most people are going to be working with agent workflows in 2024. And this is, I think the first example of that is just having essentially a dedicated agent in the form of a desktop app that can see what you're working on, you can talk to it quickly and it can help you work in real time. At least to me, that was probably the most impressive piece of the demo. There were a lot of other things that were really cool, but that was one of the most impressive to me. Number seven. And hey, if you do have your question, get it in. We don't have a ton of time, but we'll try to get any of your comments. You know, Douglas said he doesn't have four. Oh, yet you might have to, you know, if you are listening to this live or, or on the podcast, you usually, this is just, I'm an Internet dork. So try logging out, clearing your cache, clearing your cookies, logging back in and presumably you might have it at that point. But I'm guessing this, like most updates from not just OpenAI chat GPT but any large language model, you know, they're iterative, they're slow, slow to roll out, they go in phases. Sometimes it's available to everyone, sometimes, you know, you might have to wait a couple hours, a couple days. So yeah, make sure to go check that out. All right, so here's another big piece, number seven. GPT4O is rolling out the API at a reduced cost. So OpenAI said it is much faster and much cheaper to use the API as well. So what that means is there are literally thousands and probably tens of thousands or even more of products that you probably use every single day that are connected to to ChatGPT via OpenAI's API. So presumably what that means is those programs are going to be getting faster and better because they will have access to this new model. And OpenAI said it is much cheaper and much faster. So presumably also right, especially if you're an enterprise company and if you're paying a lot of money, maybe you got into a contract with a company maybe a year ago and it was pretty expensive, you should be revisiting that contract because especially over the last year and you know, the API has gotten much more affordable and faster, but now even with this, it is getting even less expensive. So, so pretty pretty big news, especially if within your company's tech stack you're working with multiple, you know, pieces of enterprise software that have a OpenAI GPT connection via their API, which is, you know, nowadays it's like any, it seems like just about any enterprise software, whether it's marketing, advertising, communications, CRMs, etc. It seems like they all have some connection to GPT. All right, number eight, so OpenAI demoed a live view mode, presumably being able to use vision in real time. I say presumably right, because I, I never really want to report on things even when they look true. Because, you know, Google really just, you know, kind of. I won't say that they straight up lied to everyone, but they were not very truthful in their original Gemini marketing video in December. But it did look very legit and very live from OpenAI. But essentially where you had some people on the stage, some developers, you know, literally just turn on a camera and it is a live view on the camera and just say, hey Chat gbt. What is my reaction? You know, and the developer was smiling and ChatGPT said it looks like you're happy. So the new model was able to literally recognize video in real time, which was crazy. Another one was solving a math problem, a simple equation in real time. Again, the developer was showing the camera and, you know, literally working out a math problem by hand and asking ChatGPT for directions on how to solve this is essentially, it looks like OpenAI is delivering on what Google teased with its marketing but never actually had working six months ago. So pretty, pretty impressive there. Number nine, reduced latency with a real time feel in voice to voice communication. This piece was huge. So normally if you've used any voice model, even if you were using the, the voice Mode on Chat GPT's app previously or anything right so the Google, you know, Google Assistant, Siri from Apple, you know, Alexa from, from Amazon, most of these systems have a noticeable delay. Even if it's maybe only a second, it's pretty noticeable. It's. It doesn't seem like real time conversation, at least in the demos with OpenAI didn't seem like that. The latency was very low at times, not even noticeable. Right. Like I was listening and observing and I'm like, wait, that's probably faster than I can respond if someone asked me a question. Right. Sometimes, like, I take a second to like actually process something and think about it and I'm like, this is a pretty quick, pretty quick response time. The latency was super low. Another thing is you can kind of cut off ChatGPT or GPT4O when it's responding to you. So if it looks like it's going in the wrong direction, you can just speak and essentially cut it off and correct course. So the latency was. It seemed pretty, pretty low. All right, number 10, a couple of more things. 10 just was a much more human feel, including, yes, there were some mistakes which led me to believe, all right, maybe this was actually live and not real. Right? Yeah. Unfortunately with Google Gemini, I think a lot of people have a mistrust of AI models, right? And I think the Google Gemini kind of marketing stunt, so to speak, in December with their Gemini model only increased people's mistrust in these big tech companies who are saying like, oh, look at our AI does this, this and this. And turns out with Gemini, none of that was really the case. It was all kind of manufactured behind the scenes. But with this, there were some mistakes. There were some mistakes in OpenAI's demo, which I actually liked because that told me like, okay, this is believable, right? So at one time the developer asked OpenAI question and it was responding about something else. It was responding about, you know, oh, the, the wood in the table. So this was probably from a previous response. The developer just said, oh, nope, not that. That was our last conversation. I'm asking about this. And course corrected. And then ChatGPT instantly got the question correct. So it did have a much more human feel, including that, yeah, it was getting a thing or two wrong, which obviously over time and when millions of people are using it and providing feedback in real time like, yes, this is good, no, this is not good. You know, presumably this model is going to get smarter. So next, next, next piece here, 11 of the 12 things that you need to know about the new GPT4O. It will start to roll out to users in the quote, coming weeks. All right, so like I said, a lot of people, myself included, already have access to this new model. If you are a paid user, go ahead and try now. Love what Liz said here. She said, jordan is every IT manager. Try turning it off and back on again. Yeah, exactly. So if you don't have access yet, don't worry, you'll probably get access in the coming days. But not all of these features are available yet. Right. You know, right now, this new model. So it's two different things. You have to about think. Think of it as that there is a new model and then there are all of these features that work with the new model. So it looks like OpenAI is probably first going to be rolling out just access to the new GPT4O model. Again, O stands for Omni model or the, you know, kind of what they're hoping is or will be referred to as the everything model in the Omni model. So it does. Most people are going to have probably access to that first before all of these other features, but do pay attention. So we don't know what's going to be rolling out first. As an example, will all of these updates first be coming to the app? Will the desktop app, you know, kind of the smart desktop assistant be rolling out, you know, in the coming weeks as well? Not sure, but do check. And obviously if you tune in to everyday AI, we do this show literally every single weekday. We go live at 7:30am Central. So maybe this is your first time listening. So, you know, as these new updates get rolled out, we'll obviously talk about them on the show and then we have Google. Our last thing to know is Google is likely in trouble. So, you know, we have A commenter here, Cyber S from YouTube saying, Is anyone excited about Google tomorrow? Yeah. So the timing on this one is interesting. Right? So OpenAI just officially announced this, this event about three days ago, whereas we've known for a couple of months that Google has their I O developer conference tomorrow. So OpenAI just kind of swooped here and maybe potentially stole the limelight. I mean, we'll see what Google announces tomorrow. But man, if I'm, if I'm sitting in the seat at Google, I'm not feeling super great. Right. Number one, you know, a lot of these kind of features or capabilities were teased by Google, like I said 6 months ago in their original Gemini marketing video and turned out that a lot of it was manufactured behind the scenes. Kind of this ability to interact with an AI in real time. It wasn't real. None of it existed. Right? Google later shared a research paper that said, oh, here's how we actually put it all together. It was multiple steps and a human was involved. We took the video, we grabbed frames, then we prompted and re prompted the AI and then we spit out this result. So it wasn't actually true. So if I'm Google, I am not feeling good heading into the IO Developer Conference tomorrow, if I'm being honest, because OpenAI just came and kind of took their lunch and their dinner. All right, so tune in for that. Actually tomorrow we're going to be coming in with hot takes on what this actually means. All right, so today is kind of Extra Edition, just bringing you the facts on this new GPT4 model. So again we're going to go over it very quickly here. Here are the things you need to know. The new Model is a GPT4 variation called GPT4O, which stands for Omni Model. GPT4O will be available to free and paid users. Paid users will have 5x the capacity limit. As free users, we don't know what other differences there will be. 4. Even free users will soon be able to Access the GPT store. 5. GPT4O combines transcription, intelligence and text to speech all in one mode. 6. The new desktop assistant will be coming out that can hear and see what you're working on. 7. GPT4O will be rolling out to the API at a reduced cost. 8. OpenAI demoed a live view mode, presumably being able to use vision in real time. 9. We saw a reduced latency with a very real time feel in voice to voice communication with the new model. 10. It had a much more human feel even including mistakes and the ability to cut off the model. 11. It will start rolling out to users in the coming weeks. A lot of people have access to the model. Features will be rolling out and 12 I personally think Google is in trouble, so we'll be talking about this tomorrow. If this was helpful, let me know in the comments. Hit that repost. Share this with your friends if you're listening on the podcast, maybe for the second time today. Thank you for your support. If you want to leave a review on Spotify or Apple, we'd super appreciate that. So we hope to see you back tomorrow and every day for more Everyday AI. Thanks y'.

All. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going For a little more AI magic, visit your everydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.