EP 413: Real-Time AI Search Battle - ChatGPT Search vs. Perplexity vs. Google vs. Copilot vs. Grok

This is the Everyday AI show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business and everyday life. How we use the Internet is changing and it's changing because of artificial intelligence and large language models. And you may think this is a small thing, right? Either a minor upgrade or a minor inconvenience, depending on how you look at it. But it's actually going to change everything because AI search is going to start to infiltrate and it already has every aspect of our work and personal lives. Everything from traditional Google searches to large language models to voice assistants. Things are changing very quickly. You need to know what's going on, how to work and some of the limitations. So we're going to be going over that today live and talking about real time AI search and putting together a live head to head battle of all the biggest juggernauts here in this space. Chat, GPT, Perplexity, Google, Copilot, Grok, and even Meta AI. So I'm excited for today's episode. So what's going on, y'? All? My name's Jordan Wilson and welcome to Everyday AI. Before we get started off, have to give a quick shout out and a thanks to our partners at Microsoft. So why should you listen to the Work Lab podcast from Microsoft? Because it's the place to find actionable insights to guide your organization's AI transformation. Tune in to learn how to think more creatively about unlocking the full potential of the technology. That's W O R K L A B no spaces available wherever you get your podcasts. All right, so another place to get your podcast and everything on AI is here. Welcome. Like I said, my name is Jordan, I'm the host and this thing's for you. It is a daily live stream, podcast and free daily newsletter helping everyday people like you and me not just keep up with what's happening in the world of AI, but how we can use all this information to get ahead. Right? I get it. It's hard, like you feel like you're constantly being left behind. That's what our daily show is all about. But it starts here. If you're on the live stream listening on the podcast, make sure to check out your show notes because where you actually go to grow is your everyday AI dot com. There you can find now like 420 plus episodes of everything in the world of generative AI. Go, watch, listen, read them all there. It is free. It is the number one resource of free, unbiased information on everything AI for beginners. So make sure you go check that out and sign up for our daily newsletter. All right, so before we get started, half, we're going to start off as we do almost every day by going over the AI news and hey, live stream audience, give me please a specific business related query that you normally Google search. We're going to use those live later. All right, so some big AI news today. So the Intel CEO has stepped down amid struggles. So Pat Gelsinger, Intel CEO since 2021, has stepped down as the company faces challenges in the rapidly evolving AI sector. So intel has struggled to compete with Nvidia, whose GPUs are preferred for AI tasks due to their efficient parallel processing capabilities. Under Gelsinger's leadership, Intel's stock has declined by 61% while at the same time Nvidia's has soared over 820% during the same period. A little bit of a difference there. So Intel's market value is now approx. $100 billion, significantly overshadowed by Nvidia's 3 trillion dollar valuation. So Intel's restructuring efforts are described as the most critical since its inception in 1968, have yet to restore investor confidence. This leadership change highlights the urgent need for intel to innovate and adapt to maintain relevance in the AI driven tech landscape. All right, next piece of AI news. Republican Senator Ted Cruz has called for an investigation into whether European governments are influencing U.S. laws on artificial intelligence, according to Reuters. So Cruz's concerns arise as European countries led by the EU have implemented comprehensive AI regulations, including the AI Act. In a letter to U.S. attorney General Merrick Garland, Cruz criticized the Biden administration for allegedly collaborating with foreign governments on AI policy. Cruise described European AI regulations as bad and accused them of being influenced by the quote, unquote radical left. So you know, it's, it's going to be really interesting to see the potential political AI policy being politicized in the coming weeks as we go through a change in administration here in the US and then last but not least, World Labs, well, we finally know a little bit more of what, what they're actually going to be doing. So World Labs is a startup founded by AI pioneer and who many call the godmother of AI, Fifi Lee. And it's launched an innovative AI system that transforms a single image into an interactive, explorable 3D scenes. This is wild. So this technology stands out because it allows users to step into and explore 3D 3D environments generated from images, enhancing interactivity and modifability. Unlike many existing AI models that create 3D environments with consistency issues. World Labs Systems maintains the integrity of generated scenes adhering to basic physical laws. Then the AI generated scenes can be explored via a demo on World Labs website featuring live rendering in an adjustable depth of field for enhanced realism. Despite its advancements, the system is an early preview stage with limited exploration areas and occasional rendering errors. So, yeah, World Labs has already secured $230 million with, you know, it's only been out there for a few quarters in VC money from notable investors aiming to release its first product by 2025. All right, y', all, so let's talk about it. And, and hey, thanks, thanks for the questions coming in so far, you know, so Denny, maybe we'll get to yours, but please, if you have questions on how you would normally use, you know, the web at your job, right? What are queries that you're normally, you know, looking up on a daily, weekly, monthly basis. Today's show is going to be a live one. All right, but first I want to set the scene on why this real time AI search battle is relevant for all of us. Well, I think ultimately it's about our devices, right? Because how we use our devices, whether that's a computer, whether it's a mobile phone, it influences a lot. Right? And that generally starts with a search engine. Right? And we actually are going to have a show tomorrow talking about this a little more. So we kind of have a 1, 2 combo here for you. So if this is up your alley, make sure to tune in tomorrow as well. But there's been a lot of recent updates from all the companies in big tech. And I've noticed over the coming or, sorry, over the last few weeks, this growing trend. So one, large language model makers reportedly getting into hardware, right? And then your traditional big tech search companies continuing to prioritize AI results, right, And AI real time information. But where do you start? What do you use? We're going to get into this, but let's quickly go over what's new. And y', all, I, I, I might have some takes on this, right? It's, it's hot take Tuesday, so let me know if I should take it easy on everyone or if I can ramp it up. All right? It's up to you guys, as always. So over the last few weeks there's been a lot of recent updates. So one of the biggest ones has been open AI. So previously they had a standalone protot type called Search GPT. Right. It wasn't available to a lot of people, but it was kind of a Standalone product. And then last, you know, about five weeks ago, actually OpenAI finally released this to the public and it's now just called Chat GBT Search. Right? And if, if you're a long time listener of the show or reader of the newsletter, you actually knew about this. This actually was possible before ChatGPT search. With some clever prompting, OpenAI has quietly had a perplexity type of clone or a perplexity type product for about eight months. No one knew because they didn't really announce it, but it's been out there, right? But now officially we have ChatGPT search that was unveiled, I believe it was October 26th. And this is integrated now, an integrated search engine into Chat GPT, right? So it was a standalone product, now it's integrated and it's grabbing real time data retrieval and positioning itself as a competitor to Google's search dominance. Right. We haven't seen the most latest statistics from 2024 yet because the year's still going. But in most years, Google controls more than 90% of search revenue and depending on what study you look at, anywhere from like 75 to 85% of search traffic. So everyone's trying to get to where you start, right? That query, how you start your day, do you go to a website, do you go to google.com, do you go to a start page and just search from there? So much of those ad dollars and how companies actually make money depends on the search bar. And that's why we have to pay attention to these updates. Another big one from OpenAI, well, they released a Chrome extension. Sounds small, but it's not, right? A sneaky way that OpenAI is allowing potentially hundreds of millions of users to skip Google, right? So if you enable OpenAI or ChatGPT's Chrome extension and you go, as an example, if you have Chrome or Edge, because all of these work in Edge as well, and you go, go. And you know, normally you might put something in the URL bar, which is also a search bar. Now it just bypasses Google and it just launches straight into Chat GPT. And here's, here's why I'm like, okay, I know Google's worried about this, everyone is, because now you get a little prompt. So the first time after you install the Chat GPT Chrome extension, it says, did you mean to change your search provider? Google's like, yo, like, are you sure you want to do this or do you want to change it back to Google? Right? So everyone's aware that there's a battle for users and where they start. All right, all right. Kathleen and Tara said bring, bring a little fire. We'll try. All right, so Google's scared. They should be, right? Because if, since you guys wanted some, some heat, I think Google was grossly behind everyone else when it came to pairing up their large language model Gemini with real time search. We have literally more than a thousand videos on our YouTube channel, right. So you can go subscribe to that. But we showed you once Google Gemini was released and probably in the six months after it had a real hard time connecting to Google, connecting to real time information. And the early AI overviews from Google were a little sketchy. I think they've really improved. So you got to tip your hat to Google because I think they've improved recently, but we're going to be doing it live. All right, here's what's also happened in the last few weeks. Google has expanded AI overviews. We're not going to be comparing those because they're a little different. Maybe that's another show for another day. But they've expanded AI overviews in search to over a hundred companies, sorry, 100 countries, right. Whereas before, I believe it was seven when it first rolled out. So bringing these AI generated summaries to everywhere. All right, so even if you're not going into Google Gemini as an example or Chat GPT, you're probably already using these AI search, right? With Google AI overviews, once they, you know, they had some bugs early on, but they're pretty, pretty decent now, right? It's, it's, you know, kind of a maturation of what Google has always done, right. There's always something called, you know, in the SEO world like position zero, right. Where essentially it wasn't an answer. Right. It was kind of like a precursor to AI search. Right? Now if you put in a certain query and Google had an answer, you know, there's something, they might call it a knowledge graph or something like that, but it essentially answered it there for you. But now with the AI overviews from Google, it's really expanded, you know, bringing that AI search capabilities even to Google's homepage. We're not going to be comparing that live today, but pretty big. Some other big recent news. In the last few weeks, the browser company has previewed DIA, an AI focused browser set to launch early 2025. Cohere, right? We don't talk about cohere a ton here on everyday AI, but when it comes to enterprise companies, cohere is, is a, is a force to be reckoned with. So they Just released and previewed re rank 3.5, which is an AI search model that processes queries in over a hundred languages, improving enterprise search accuracy by 30 according to them. Right. And then a couple other ones, Perplexity. Right. So now Perplexity is bringing shop with Perplexity. Right. And also their CEO has said that they're going to be developing hardware. Right. I started the show by talking. I think ultimately it's about hardware and pairing AI search with the hardware. We've also seen, you know, reports over the last year that OpenAI CEO Sam Altman is working with former Apple designer Johnny Ives on a hardware device as well. So, you know, you have hardware, traditional hardware companies going into search, kind of traditional AI or large language model companies, you know, putting out, you know, AI search products and hardware. Right. So everyone's competing for where users start. Microsoft and Bing aren't any different. They just launched Bing, did their generative search experience. So you have not just Copilot, but in traditional Bing, you're getting these AI powered searches as well. And Meta. Yeah, every single big tech company. I'm not, I'm not kidding. Meta announced the development of a proprietary search index for its AI chatbot to reduce reliance on external platforms like Google and Bing that is making their own search engine. Everyone wants to control where you start your day, right? And if you're not using in. In AI, you know, or a large language model solution, they're coming for hardware and traditional search engines. So if you're still going old school, you need to stop. Right? You need to stop. But first, what you need to know is what works where. All right, so Live Stream crew, like I said, please give me, please give me a suggestion or two. What is something that you routinely search the web for? All right, so I, I have, I have a couple, A couple ones. A couple ones here, so please get them in. But I also, if possible, it should be something that's easy to grade. Right? So, hey, although I love this one, Fred, Fred says, how will quantum computing impact AI energy needs? Hopefully it's something that I can easily say like yes, no, or maybe. Right? So something that maybe you've gotten hallucinations with in the past. Maybe something that, you know, it's. It's definitive, right? Yes or no? Is it correct or is it not? All right, so before we, before we jump in to this live demonstration and podcast audience, I'm going to do my best to visually describe what's going on, but we're doing a live throwdown of searches that you would Just normally do. But before we get started, have to give one more quick shout out to our partners at Microsoft Worklab. So why should you listen to the Worklab podcast from Microsoft? It explores the questions business leaders are asking. How can they guide their organization's AI adoption journey? How can AI help them maximize value and create new products and business models? How should they help their teams reskill for this new era of work? Why is it important to be completely transparent about when and how you use AI? Find the answers on Worklab. That's W O R K L A B, no spaces available wherever you get your podcasts. All right, y', all, let's do this live and let's kind of talk about the real time AI search battle. All right, let's get into it. So live stream audience, please let me know if you can see my screen. Hopefully this works as we're jumping around here, but let me just quickly describe what we're going to be doing here. All right, so we have some very simple, and I'm not even going to say these are prompts, right? We're doing traditional searches because I think people, when they think of large language models, you think of prompting something, you think of having a conversation. Yes, that is the correct way to use it. However, what I just talked about, every one of these big companies are coming for your traditional search queries. And I do think that there's two different things, right? I think a traditional search query might be a, you know, two to five word query that something that you just care about. Whereas if you're working with a large language model, you're probably having a back and forth iterative conversation and using more words. But in this case, we are doing very short, traditional search phrases and we're seeing how all of these new products and new updates that we've been talking about across these different, these different stacks here, handle them. So like I said, we're going to be doing chat GPT search and I'm using paid versions for all of these except meta AI. So we're going to be going over chat GPT search Perplexity, Gemini Copilot from Microsoft, grok, yeah, GROK and meta AI. And we're going to be running the exact same simple search queries. Again, this is not a prompt engineering head to head. This is taking a look at how these AI companies and big tech companies are changing our search queries. All right, so we're going to start with sports and we're going to do the same, the same search very quickly. All right. Because I Don't want this to accidentally drag on for an hour. And all I'm doing here is when I'm using Chat gbt, I'm going to toggle on the Chat GPT search. Although generally, even if you use a query that would re. That Chat GPT thinks, oh, I need to search the web, you know, some of the times, it would automatically understand that it needs to search the web instead. But just so everyone knows, we're going to be using the same chat window for each of these, which shouldn't technically throw anything off. It just makes it a little bit cleaner. And we're going to be toggling the search option on inside of Chat GPT. All right, so we're doing. Our first one is sports. So we have our scorecard, and we're going to give every. We're going to give them all essentially a 0, a 5, or a 10. All right, for the most part, if, If I see that there's, you know, some gray area, we might do other scores, but for the most part, a zero is a hallucination or they get it wrong. A five is like, okay, that's. That's partially. That's partially right. And then a 10 is like, okay, that's. That's pretty much. That's pretty much right. All right, so like I said, if you do have other ideas, get them in now, because we're about to fly through this. All right, so here we go. Our first kind of prompt. We're just saying bears upcoming schedule. All right, I'm a Bears fan. Any Bears fans in the live stream audience, we're getting a new coach, which is great. The Bears find great ways to lose. All right, so we're going to do this very quick. We're also using the pro version of Perplexity. All right, so that's all we're doing, is just the words Bears upcoming schedule, nothing else. And I'm quickly jumping between all tabs here. All right, and we're gonna keep tabs on did it get it right? Did it get it wrong? All right, so let's see. So Chat gbt, the new Chat GPT search. Love it. Very visual. So we. We have this kind of quadrant of their next four upcoming games, including team logos. There's links. I can go down here, click the sources. It pops the sources out on the right hand side. So if you haven't used chatgpt search, I'm not going to do a whole overview here, but I want to describe to our podcast audience. So obviously, Got this. Got this right, Did A good job, too. All right, so the answer is the next game. The Bears play the 49ers Sunday at 3:25pm Central Time. All right, let's take a look at Perplexity. Did Perplexity get it right? Kind of. So here's the thing. All I said is Bears upcoming schedule. What Perplexity did, and it requires a lot more scrolling. It didn't really deliver me the answer that I wanted up front. So what it did, which I don't like this. It just gave me their entire season schedule. So it's like this is technically outdated. So not only did it not put the upcoming game, because that's what I asked for, it didn't give me the upcoming game. It just essentially gave me this information. Looks like it could be eight months old. It's not updated. It doesn't give me the. The game first. Right. And there's no scores. So these games are in the past, right? From September. And there's not even results. Right. I would get it if it at least gave the results, but not very good. All right. But it at least does have there if I scroll down. So not that great from Perplexity, if I'm being honest. I don't know if I should give that a. A five or a zero. Live stream audience, I'll let you vote. Should I give that a 5 or a 0? Let's go to Gemini. Gemini straightforward here, right? Gave me nothing else. Just answered my query again. Visual just gave me the bears 49ers and then the next game. So gave me the next two games. Straightforward. I like it. Gemini passes. Great. Gemini's like their. Their old version of Gemini, like six months ago was terrible. It could not connect in real time to anything on the web, which I've warned people about. I'm like, if you're trying to use the front end of Gemini Chat right now, stop, because it can't even talk to Google. So like I said, you got to tip your cap when the company improves. All right. Microsoft copilot. So no visuals here yet. It did give me the next game. Okay. As well as the next upcoming games and two different sources that I can click on below. So got everything right. Pretty straightforward. I'd say it passes with a 10. Grok. Here's. Here's the. The wild card, right? So if you pay for. I think it's like $7 a month for Twitter's premium version, you get Grok. I'm not a fan of Grok. I don't think it's very good, but for one of its biggest, you know, value props is it's great with live information. Right? So let's see how it does. So fortunately, slash, unfortunately it, it searches both post or tweets on Twitter. I'm not going to call it like axes on ax. I don't know what that means. So it searches both recent Twitter posts as well as web pages, which is a good and bad thing because depending on what you're searching, and I've done plenty of examples of this, sometimes it brings up just a bunch of misinformation in, in essentially tweets from spam accounts. Right. Which using real time information from Twitter, depending on what you're looking for is problematic. All right. But for this, the Bears upcoming schedule got it right. So There we go. 49ers, it put it in Pacific time, but that's okay, it's still accurate. It gave me week 15 and 16 and then I can, if I want to, I can click on the post and see the posts that it grabbed that it grabbed from as well as the web pages. Right? Because that's important, especially things with like transparency and trust. You have to know where it's getting this information from. So I'd say Grok passes with a 10. And then let's see Meta AI. So a lot of people don't know, but Meta AI, you can just go to Meta AI, right? You can log, you can use it without being logged in, but it won't save your chats. This is free. So this is the only free version I'm using technically the paid or premium version for everything else, including chat, GPT, Perplexity, Gemini, Microsoft Copilot, and Twitter's Grok. But the free version here for Meta AI, so it uses Google on the back end. Right. So let's see, it did a good job here. Just no, no visuals. So you know, meta doesn't give you this kind of rich snippet, type search results, just straight text, which isn't necessarily a bad thing. All right, so we got it right. It said, you know, the next game there it up top, it gave the, the 49ers. So a 10 from Meta. All right, so here's our scorecard so far. Let's, let's see. What did everyone, what did everyone say? Ted said that not Gemini. It should have been perplexed. Oh, Perplexity is the one we're figuring out. Sorry. So a lot of people said five for Perplexity. All right, so Per Perplexity gets a five. Everyone else got a ten in that one. So it passes. All right, our next question. We are doing stocks. All right, so here's what we're doing. Sports, stocks, weather, news, places, and at least one or two from the audience. So if you have one, get it in. All right, we're going to pick up the speed here. So now I kind of gave you an overview of what each of these platforms give you, right? So both visually, the results, how they access the web, etc. So now all we're doing is Nvidia's stock price, and this is a live stream, y'. All. So their current stock price is $138.63 per share. So 138.63. So let's see. Let's see how everyone did here. All right, so first let's go to Chat GPT. So Chat GPT actually gives you super nice interactive graphs because of Chat GPT search. I didn't know if you knew that, but we got a perfect, perfect kind of score there. And the markets are going to open here in about 30 minutes. So it's not like this is changing as we go along. So there we go. We got a good result. We got a good result from Chat GPT. And I appreciate everyone's patient here. I'm toggling. You know, doing a live stream with many different windows is, is sometimes a little tricky. So appreciate everyone's patience here as I scroll through. All right, so there we go. Let's go to Perplexity. So Perplexity, same thing. You get a live real time graph. Love this from Perplexity. So perfect score there. And it says 138.63. Straightforward from Gemini. Right? Gemini. You get a nice little visual as well. Up to date. Crushed it. Perfect. All right, 10. Let's see our friend copilot. Let's see how Microsoft Copilot did. No visuals here. Straightforward though. Got it right. $138. Nvidia is on fire. If. If only you would have listened to someone like a year and a half ago that said Nvidia was the most important company in the world. All right, Grok got it right. 138. All right, so so far, everyone's crushing it. And let's look at Meta. Meta got it right as well. So every single kind of chatbot or AI search engine got this one correct. Pretty impressive. All right, next, let's do weather. All right, so I'm gonna. I'm gonna go ahead and check the actual weather here in Chicago in real time. So it looks like it's roughly 22 degrees. All right, again, this is things that you would normally be searching for, right? You probably have an app on your phone. But think, you have to think in the future we might not be using websites, right? I know that sounds crazy. Let me repeat that. We might not be using websites. You might just be using, you know, your large language model or something like Apple Intelligence if it ever gets smart, right? You just might be using something that's powered by an AI search engine. So right now in Chicago, it is 22 degrees Fahrenheit. Yuck. All right, so let's get back to our searches and do weather in Chicago. All right, so we're going to do this one like I said, very quickly and we are doing them all real quick. So let's see who's gonna win, y'. All. Actually, let's live stream audience. And if you're listening on the podcast, write down. Now who do you think is ultimately going to win this? Because we're going to crank up the speed here. All right, so let's see. Chat gbt. And I'm gonna give. It's, it's, it's hard to say, right? Because I'm, I'm even searching right now. I'm getting different results on, you know, weather.com versus AccuWeather. So as long as it's within like 3 degrees, right? As long as it's not wildly wrong, we're going to give everyone, we're going to give everyone a 10 here, right? So as long as it looks like yes, it's actually accessing the information. All right, so Chat GBT with the new Chat GPT search. Very nice visual table. My gosh, I'm starting to hate using weather apps because you gotta like watch like a 15 second video just to get the freaking weather right. Annoying. All right, so chat GBT says 20 degrees. Very visual, very nice. Perplexity. We'll give this to perplexity, right? It, it looks real time. It says current. It says 18. 18°. Close enough, right? Because I'm getting reads between 20 and 21 when I check manually. Gemini advance 21. Gemini looking nice here, right? Who knew? Gemini isn't really improving for at least simple real time searches, things that you might normally Google, right? We get a nice, a nice visual here and you can kind of scroll through, scroll through the hourly forecast there. Very nice. Oh, let's see. I don't know. So copilot, it's pulling it from forecast.weather.gov it says 25. Okay, so it says a high of 25 in a low of 14 tonight. However, I didn't say what is the weather right now. I just said weather in Chicago. All right, so live stream audience, you're the determining factor. Do we give copilot a. A five or a ten on this one? Technically, it's correct. I didn't say what's the weather now? It gave me a high and a low. I just said weather in Chicago. All right, Grok, Grock says the current temperature is 16 degrees Fahrenheit with a high expected to reach 29. Is it actually gonna hit 29 today? I don't think maybe. I mean, maybe. Maybe it will. Maybe it will. So Grok. All right, I'm gonna say that passes and then meta AI. So unfortunately it looks like meta. Oh, let's see. Meta AI says it's a chilly day in Chicago with partly cloudy skies and a temperature of 18 degrees Fahrenheit. All right, so I think mostly all of them probably got a 10 unless anyone says CO pilot gets a 5. All right, most. Most of you guys said it passed. All right, all right, so it passed. Everyone, everyone there passed. Yay. Did the. Did it do better than your local weather person? All right, now here's. Here's one where we might have to get a little bit specific with the grading. So now I'm saying top AI news stories for this month. This month is December. So I didn't say for the past month. I'm saying this month it is December. So we're doing all of these and this is where I'm, I'm probably gonna judge these on the fly. I promise you I'm not going to be biased because I think a lot of times when you ask for news stories, some of these large. And this is something you would probably be using these models for for business, right? What's happening in your industry and your vertical, etc, a lot of time they give these general. General outputs, right? Like, oh, you know, there's all these new advancements, right? So if I see some of that, probably going to give it a five, right? Maybe lower. Depends on what else we see. All right, so first, chat gbt. And again you get this kind of links at the bottom where you can click the sources as well. All right, so let's just kind of see a couple of things. So it says as of December 3, 2024, several significant develops. All right, so US imposes stricter export controls on AI chips to China. We had that in our newsletter yesterday. The some European Defense startup news. OpenAI targets 1 billion users. This is all Very, very recent. Which makes sense because we're only December 3rd. All right. AI chatbots enhance holiday experience. Yep. Good. All right, so this is all hot, fresh AI news from Chat GPT. All right. And live stream audience, I know a lot of you are giving me your scores. Just let me know, like, news Chat GPT. Right? If. If you want to score it at the end, just at least let me know what category. So if I need to, like, go to you for an answer, I at least know what you're talking about. All right, so Perplexity, top AI news stories for this month. AWS leadership change. Did that happen? No, that's very old. I'm. I'm clicking this, the very first one right here. Oh, gosh. This is from August. Yeah, I'm looking at this. I'm like, that's not new, that's old. Yeah, so it's giving me old information. I said this month. And I'm looking at these stories from Perplexity. Aside from the AWS Reinvent conference, which is happening this week, none of this is from this month. I'm looking. I. I don't think. No, I don't know. To me, this. I mean, it's not a zero, but to me, that's like a two for Perplexity. These things are not from this month. A lot of these things are very, very old. So Perplexity, everyone thinks. Right. I haven't been using Perplexity or talking about it as much because I've noticed a lot of hallucinations and a lot of simple errors. Right. I've been reaching out to the Perplexity team, being like, yo, what's up? But they haven't answered my calls. All right, let's look at Gemini. All right, so here we go. It's Alibaba's cloud AI overhaul. I'm checking that one. I don't know when that one is from. I don't know if that's from this month. Let's see. December 3rd. All right, there we go. All right, so Gemini Salesforce predicts UK AI leadership. That's new. Amazon's big investment in. In Anthropic. That was technically the end of November. I'm just going to double check that. I believe that was. Yeah, November 22nd. So, okay, most of these things. Most of these things I would say are fairly close, whereas Perplexity was just very, very old. So I'm looking at some of these. It's. It's a mixed bag from Google Gemini, but much better than Perplexity. So I'm Gonna probably give it like a seven. Let me know if you guys think that's correct or not. Going into Microsoft Copilot, top AI news stories for the month. And here I like this copilot just responds, here are some of the top AI news stories for December 2024. So it at least recognizes. Yeah, I'm supposed to be giving you up to date information. So the first thing is top AI stocks to watch. I don't know, is that real? I mean it's, it's from December 2024, so that's fine. So it's giving me some more general things, but I don't think some of these are very up to date. So as an example, this one, AI and Nobel Prizes, I believe that was October or November. So essentially it's pulling from certain websites and there's dates on here. So there's a date on this website it was pulling it from that said December, but I believe, yeah, that is from November and it's actually from before that. So the AI, let's see. AI Noble surprise. I think that was. Oh, look at that. I was trying to do a Google search and I have my default to chat GPT. So I believe that was October or later. Yeah, October. Yeah. So it's, it's mixed bag there from Copilot and it is a little more general, but some of the things are new. So without going down each and every one, I'm guessing I'm going to do similar to Gemini. I'm going to give it a 7. Much more accurate than perplexity. Let's look at Grok. All right, OpenAI's trademark move on reasoning models US proposes AI Manhattan Project. I believe that's old. Yeah, that's in November and I think it was actually from before that. Elon Musk legal action. That's new. AI and advertising integration. Yep, that's new. Okay, so pretty, pretty good from grok. I'll say probably a seven. So it looks like Gemini co pilot and Grok much better than Perplexity, but throwing in some older things from October or November. Whereas chat gbt, at least according to my eye, only brought in things from December. All right, let's see. Meta AI leadership transition at. Oh no, this is, this is old. All right, so Matt is bringing things in from last year. All right, so it's OpenAI CEO Sam Altman stepping down. Elon Musk AI chatbot Grok. All right, this is all bad. All right, so the real time information from Grok gets a big fat zero because none of it was Correct. All right, let's do places. All right, we're gonna go quick. So I'm doing best pizza places in Chicago, right? This is probably something that you're googling all the time. You want to know, you know, a restaurant or a local business to shop at. So let's just quickly do this one and see who gets this kind of. Right. And I'm picking something I know. If there's one thing I know, I know my pizza places in Chicago. So let's look at Chat GPT first. All right, so if you didn't know, the new Chat GPT search has a very cool kind of interactive graph. So this is going to feel very reminiscent of Google, right? A Google map. So I can also toggle to the list view. The list view keeps the map in there but then brings the the list as well. So pretty good. Let me see. It brought in Illuminati's, Spaka, Napola, Giordano's. Uh, it brought in, okay, Coal Fire, Bert's place. I don't even know that. Uh, okay. Did, did a pretty good job. Did a pretty good job. It, it offered not just things right in downtown because I didn't say downtown Chicago. So it did get the kind of the whole area. So pretty good there. Let's look at Perplexity. Perplexity as well, gives me a little map or visual on the right hand side that I can click on. And similarly to Chat GPT, it gives me an interactive graph. So it brought in all the staples, right? Giordano's, Pisanos, Luminatis. So pretty good here. So both of them so far, very, very good. All right. Gemini. No, no interactive map gave me a great list. So it not just gave me classic Chicago, but deep dish, deep dish pizza and then for beyond deep dish. So great, great response here from Google. And it also asked me some follow up questions so it could help me better. Microsoft copilot. Simple. Give me all the staples, including Pequods. Love some Pequods. All right, so pretty, pretty good. No hallucinations so far. Let's see. Grock again, pulled in From Yelp, from TripAdvisor as well as some different post from Twitter. Same thing. Peds, Illuminatis, Giordano, give me, give me all the, the staples there. Uh, and then meta deep dish favorites, thin crust spots, unique spots. So no lies here. No hallucinations. However, Chat gbt, Perplexity gave me a little something more. It gave me maps which I like if you're thinking local. So I'm going to give the nod, a slight nod to Chat GPT and Perplexity and then I'm going to give the rest of them probably an 8 because no one was right. But I think that kind of additional aspect of having the maps in Chat GPT search and Perplexity was a little better because if you're searching for something that is location specific, having the location even though putting it out in plain text, and I know that's just some of these other options don't have those capabilities. But yeah, it's my show. I can score them how I want. All right, let's see. Jackie said only people from Chicago can vote on that one. And yes, Mark. Mark is saying Grok may be using X tweets as a source. Yes. So Grok uses both websites and tweets, which might be a good thing, might be a bad thing. All right, Jackie says I'm being too nice to Grok. I'm trying to be as un. Unbiased as possible. All right, let's see. Let's see if we got any good. We might only have time to do one, but if you didn't get it in already, I wanted to do one from the audience here. So let's see if there's something that I can actually gauge. All right, if there's a yes or no. Yes or no answer here. All right, let's see, let's see some of our questions. So, Denny, with quite a few. Thanks. Denny, when is the most recent news in topic of interest? Uh, what are fun things to do in Blank Space City? Christopher saying, you know, talking about replacing Stack Overflow. Fred, we talked about that one. Quantum computing. I can't get. I can't know the answers. How can you use the app where you have six apps open at the same time? Samuel from YouTube saying, My search from last night. What's the secret code? Clearance pricing at Home Depot? I don't know how to score that one. Okay, I like this one from Marie saying which EV vehicle is the most efficient and economical? That one's pretty good. I should probably be able to get the answer. Maybe, maybe not. Okay, here's one from Denny. Thanks for this one, Denny. I know this is kind of stock related, but this one at least has the. Has a correct answer. What. What stock has the largest market cap? All right, so we're just going to do one audience question and we're going to wrap this up. All right, so we're going to do what stock has the. What stock has the largest market cap? Yeah, I do this live. Y' All. I love typing live. All right, let's first see the answer. All right, this is a site that I'm always at. So right now Nvidia has a slight. Or, sorry, Apple has a slight advantage over Nvidia in terms of market cap. So it is a $3.6 trillion market cap. All right, so let's go ahead. Love this question because it's easy to judge. I am going to say, what, U.S. stock has the largest market cap. So pretty, pretty simple question. We should, in theory, be able to get a yes or no or partially complete answer. So I'm going through. I'm pasting this in all of our. All of our options here. And again, the answer is going to be Apple with 3.6 trillion market cap. All right, so let's go ahead and see. All right, so Chat GBT gave us a nice, nice graph, and it correctly says Apple 3.6. All right, so chat GPT passes with flying colors there. All right, let's go ahead into perplexity. So perplexity says Apple 3.6 trillion. Perplexity gets it right. All right, and over to Gemini. So I do like that Gemini said as of December 2nd. That's good. It says 3.59 trillion. Ah, I don't know. Yeah. You guys, what do you think? I mean, it's. It's like, are we rounding here? The actual number is 3.62. So let me know what does. What does. Yeah, what does Gemini get for that one? 3.59. I don't. I don't wanna. I don't want to be accused of being biased. All right, so you guys can vote. So whatever it gets, co pilot's probably gonna get the same because it says the market cap is 3.5 trillion. 3.55 trillion. So Gemini and co pilot were a little off. Let's see. Grok. Grok. Okay. Grok just got it wrong. Grok got it wrong. That's why I tell people I don't think Grok is a serious model. Because you would think, right? Because it's like, oh, According to these 15 web pages and eight tweets, you would think by looking at 23 sources, Grok could at least get this right. It got it wrong. It says. It's. Let me just double check here. Yeah, it says Nvidia 3.6 trillion. Grok gets a big fat zero, right? Everyone's like, oh, Grok's gonna be amazing. It has real time, you know, information to Twitter and. And now it can access the web. And I've been Telling people it's bad. There's no instance where I would ever use Grok. I'm sorry. Even if I'm searching Twitter, I'm not going to use Grok. All right? It's just full of hallucinations. It's. It's not good. That's my opinion. But that's why we do live tests. All right, let's see. Meta. Meta. Surprisingly got it right. 3.6. 3.6 trillion. All right, so let's see. What did our audience vote? Did we get any, uh, what should we give Gemini and co pilot? Let's see. Michael says Gemini gets 3.59 points for that. That's, that's, that's funny. Oh, I like this one. We might have to do one more. I'm sorry. We had another good one that. This one. This one should actually be a good one. So I like this one. So we're gonna give Gemini. We're gonna give Gemini and, uh, co pilot. I don't know. Sixes. We're gonna give them sixes. All right, I like this one from Michael. Yeah, I'm, I'm biased saying, how many episodes are there of the Everyday AI Podcast? I'm gonna say give it, give it a little hint here. All right. Because I don't think any of them. I don't think anyone's gonna get this right. All right, so there are 400 and. Oh, little error on our website. Interesting. I'll have to fix that up. So technically it's 412, but we had a little error there. What? It's double labeled, so it should be four. I'll, I'll accept 411 or 412, but I don't think any of them are going to get this right. But let's, let's, let's go ahead and see. All right, so quick one, we're going into all of them and we're gonna see. We're just going to see how bad they are, maybe. This is great. So, Michael, thank you for this suggestion, because if there's any ties, I believe this one is going to separate any ties that we may have. All right, so let's look at chat GPT first. So it says chat GPT says 400. All right. And it does say as of December 3, 2024. So it's a little wrong. We look at the sources, and it's bringing in a bunch of different sources. All right, so not correct there, but close. Perplexity. 415. That's wrong. It's saying there's More than there actually is. So Chat GBT went under. Perplexity went over. Live stream, audience. Get. Get your. Get your votes in, right? Get your votes in on. On where you think all these should be, because some are under, some are over. All right, so Gemini says 415. So Perplexity and Gemini both said 415. Copilot says 398. All right, Grock says three. Oh, bad Grock says 329. That's not even close. Right? And then Meta. Meta says 412. Meta got this even more correct than our website. All right, Meta. Meta. Was not expecting that. Was not expecting that out of meta. All right, so we're gonna give meta big fat 10. Good job. I don't know. Where do we. Where do we land with every. With these other ones, y'? All? I'm gonna go ahead. As we wrap up. Jackie says this was fun. All right, so let's see. Grok. Grock was just very, very bad. 329. So I don't know. Grok. I'm gonna give a two, I guess. Okay, I'm gonna give Grok a two. I mean, the rest are kind of close. 400 and 415. Maybe 415 is a little closer. So maybe we'll do Perplexity and Gemini. We'll do maybe a six for Perplexity in Gemini, and then we'll do a five for Chat GPT and maybe a four for Copilot, because copilot was a little further off. All right, so let's add up our very unofficial scoring here. All right? Let's see which large language model did the best in our very unofficial testing. So did you get it right? What you think? As I add up here, if you were to think, hey, I'm using one Internet connected large language model for my business, for my career, are you using the right one? What are you using again? This is. You know, this is a very unofficial, unofficial experiment here, y', all, so. But I'm. I'm surprised with some of the results, right? Like, as an example, I was not expecting Meta to be the only one that got that correct. So here we go. I'm gonna go ahead and order these in the order in which they did. All right, so here we go. Our final totals. Chat GPT search got a 65. Meta AI in second place. All right, so Chat GPT search number one. Meta AI number two, suppression. Surprising. Again, this is subjective with 58 Gemini updated and improved. Great job. Gemini. 57 co pilot a little bit behind there. So Gemini and co pilot in the middle of the pack. Co pilot 55, perplexity surprisingly stumbled 53 in Grok 47. All right, so we're giving our medals chat GBT number one, meta AI number two, Gemini number three, co pilot number four, performance perplexity number five and Grok last place number six. All right, y'. All. Yeah. You know what Michael? Michael says I'm so surprised by Perplexity. Their business model is search. I think Perplexity, rightfully so, had a lot of, I don't want to use the word hype. I'll use the word hope. A lot of promise in early on, I think when none of the other options could do a great job at real time search, I think everyone flocked to perhaps Perplexity. One thing that I noticed and I have done some Perplexity episodes in the past, but I, if you go back and look, I've talked about it a lot less recently because I'm noticing a trend of hallucinations. I'm noticing a trend of Perplexity missing simple things that it used to do better. Yes, you can choose your model, right? You can choose your model in perplexity, I'm using Claude 35 Sonnet. But that doesn't change the actual Perplexity's ability to browse the web and give you accurate information. So the model that you choose when using Perplexity, at least in our testing, I've done blind testing on this, it doesn't impact the results. So if you're saying, oh, Jordan, you use the wrong model, you should have used, you know, Sonar large or you should have used GPT4. Oh no, you get similar results. So if it gets it right, it gets it right. But you know the model that you choose, right? Because Perplexity is an answers engine. And you can choose sonnet3.5 or you can choose GPT4O. It just changes how it presents the information. But if it gets it wrong, it's still going to get it wrong regardless of the model that you, you choose. So, yeah, Perplexity, I think has had some, if I'm being honest, some struggles lately and I'm a big fan. But hallucinations, they're real, right? And not answering simple queries. I think especially since they introduced shopping, you can ask a query and you can ask a question about a certain product and you want an answer. And instead Perplexity is now, since they released this shopping, now they're just trying to push products in front of you. And I'm asking, right? Like I'm trying to, you know, get a new dishwasher, whatever. And I'm saying, like, hey, you know, give me specs on this dishwasher. What's the difference between this one from Samsung and this one from lg? And it doesn't even answer it. And it just says, here, go buy it. You can buy it now in Perplexity Pro, it's like, yo, that's not what I'm asking. So in my, my personal experience, Perplexity has gone, I'm not going to say downhill, but it's gradually trending downwards in its ability to deliver answers based on your actual query, which is important. All right, So I hope this is helpful. I know this was a longer one, y', all, so please let me know if this was helpful. And also tomorrow we got a nice little one, two combination because we're going to be talking about this a little bit more in depth tomorrow with our guests. And talking about the AI race is towards who owns the search bar on your phone. So if this episode, yeah, it's a longer one. If it was interesting. If you want to dive into deeper in the insights, make sure to join us tomorrow and make sure to share this if you found it helpful. And for today's recap, go to your Everyday AI dot com. Sign up for the free daily newsletter. Thank you so much for tuning in. Please join us tomorrow and every day for more Everyday AI. Thanks, y'. All. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going for a little more AI magic. Visit youreverydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.