ChatGPT vs. Bard vs. Claude 2 (Which is best?)

Matt Wolfe tests ChatGPT 3.5 and GPT-4, Claude 2, and Google Bard on cost, token limits, web access, summarization, images, coding, and accuracy. Claude handles massive text windows best. Bard has live web search. GPT-4 wins on coding with Code Interpreter.
Questions this video answers
July 18, 2023.
$20 per month.
GPT‑3.5: 4,096 tokens; GPT‑4 (as stated): 8,192 tokens; Claude 2: 100,000 tokens. (Bard: token limit not publicly disclosed.)
ChatGPT/GPT‑4: web browsing via plugins (not built-in in the demo); Bard: yes (direct Google search); Claude 2: no built-in web browsing in the demo.
ChatGPT 3.5 (free), Claude 2 (free), and Bard (free). GPT‑4 requires a paid plan.
Chapters
So recently ChatGPT has gotten some competition, specifically with Anthropics Claude 2 coming out and also with Bard getting a bunch of upgrades. So I figured now would be a good time to sort of pit them against each other. Now, before I get too deep into this, this is by no means scientific whatsoever. Obviously there's an infinite combination of potential prompts that you can try and different large language models are going to perform differently based on all sorts of criteria. And this is also by no means exhaust. There are obviously so many other criteria that I could test it on that I probably not thinking of. And as more large language models get released and as these models get improved, I'll probably remake a video like this in the future to better compare them as they improve over time. Now for this video I'm going to be comparing them on cost, token limit, the ability to browse the web, summarizing long content, image recognition, data analysis, creativity, the ability to code. Now I'm not a coder myself, but I will be able to test it on some simple HTML CSS code. The accuracy, which again is a very, very difficult test to, because different models are going to be more or less accurate in different areas that I could potentially test them in. So this is going to be a very simple analysis of accuracy. And then finally, these large language models don't help you if they're not available to you. So we're also going to compare them on availability. So let's start with what we know right off the bat. We know the cost of all of them. Chat GPT if you're using the 3.5 model, you can access it for free. You don't get access to code interpreter, you have don't. You don't get access to all the plugins and when the servers are bogged down, you're less likely to get in. If you're on the free version, but it is available for free. Then you've got ChatGPT4. If you want to use GPT4 it costs 20 bucks a month. But you also have access to all the plugins. You also have access to code interpreter. And when web browsing is available, you have access to web browsing. And then you have Claude 2. Claude 2 is also currently available for free for anybody to use. And then there's Bard, which is also currently available for free for anybody to test and use. Next we have the token limit. If you're using the free version of ChatGPT or 3.5, you have access to 4096 tokens. Now this is not an exact science, but as a rule of thumb, the amount of words that you can combine input and receive as an output from the large language model is roughly 75% of the token limit. So with GPT 3.5, with a token limit of 4096, you roughly will get an input slash output of about 3,000 words. If you're using GPT4, the model we have available right now, Instead of chat, GPT gives us access to 8192 tokens, which is roughly about 6,000 words combined input and output text and Claude 2. Now this one really, really shines in that it gives US access to 100,000 tokens, or roughly 75,000 words between input and output, which is amazing if you want to copy and paste an entire book in there and have it summarize something like that for you. And then there's Bard, which the token limit has not been made publicly available. So we don't actually know how many tokens we have access to inside of Bard. Those are some of the givens. That's what we know right now. Some of these other ones are going to be fairly subjective as we start to test them. So let's start to test Web browsing first. GPT 3.5 does not currently have access to web browser. GPT 4 had access to web browsing for a little while, but they took it away from us because people were able to summarize websites that were behind paywalls and they're trying to fix that before they give us access to web browsing again. However, GPT4 does have access to a bunch of various plugins and some of these plugins do have access to the Internet. For example, there's this web requests plugin that we can enable here and we can type something like, what is the site FutureTools IO about? It starts to use the web requests and there we have it. The website FutureTools IE is a platform that collects and organizes AI tools. The goal of the site is to help users find the exact AI tool that they need. And then it lists a bunch of tags that are available. The site also features a section called Matt's Picks and you can see it gives us a screenshot of what the Future Tools website looks like. We do still have access to web browsing, it's just not the built in browsing that we had before. It seemingly does kind of the same thing. Let's go ahead and use the same prompt here. Let's jump over to Claude and let's try the same thing. Let's paste this in what is the site Tools IO about? And it says, unfortunately, I do not have enough context to provide a detailed summary of the website futuretools IO as I do not have access to view the full content of the site. Let's just go ahead and say can you browse the web? No, I don't have the capability to autonomously browse the web or access websites directly. All right, so let's jump over to Bard and paste in this same prompt here what is the site FutureTools IE about? FutureTools IO is a website that lists and reviews AI tools. It was founded by Matt Wolf, who is a writer and entrepreneur. The website's goal is to help people find the best AI tools for their and it lists off some tags and Bard we do know has access to search Google. So yes, it can actually browse the web. So jumping back to our Comparison chart here, GPT 3.5 no web browsing. ChatGPT 4 yes with plugins Claude 2 not available and Bard yes, it just has web browsing directly built in. All right, so let's talk about summarizing long content. We'll start with GPT 3.5. There's this great article on NotBoring Co by Paki McCormick here called the Great Online Game. It's an awesome article, but it is quite a hefty long read here. So let's go ahead and copy the entire text of this article here. Let's paste it into GPT 3.5 here and then ask it how many words is this article? So the word count on this article is 2661 words. It should fall within our token limit of at least these three. Not sure about Bard yet, so let's go ahead and type summarize this article into bullet points. Author discusses the concept of the Great Online Game and how it's played by Bill Millions of people Social media platforms are seen as a manifestation of this game, but it extends beyond them to various online and offline spaces. Article highlights individuals who have excelled like Elon Musk, Lil Nas X and the creators in the crypto space. Crypto is described as a supercharger for the game. The author explains how to play the game, emphasizing experimentation, engagement and building connections, et cetera. So not a bad summary. So let's go ahead and do a new chat. Let's jump over to GPT4. We'll paste the same prompt in here and let's add summarize the above article into bullet points. Interestingly, when I paste this into GPT4 although it should technically have a higher token limit than GPT 3.5. GPT 4 is telling me the message I submitted was too long. Please reload the conversation and submit something shorter. Let's regenerate response. Yep, I get the same thing. When I used GPT 3.5 Turbo, it allowed me to paste that in and get a response. When I use GPT4, it says it's too long. So I actually believe what this means here is that we're actually not using this 4096 token limit. With ChatGPT 3.5, we're probably using the 16,000 word token limit, which would give us roughly 9,000 words. Again, I'm not 100% sure. I'm just noticing that when I use the GPT 4 model, it says it's too long to work with. When I use the GPT 3.5 model, it actually summarizes the text properly. Interestingly, at 2,661 words, it should work in both of them. So let's go ahead and confirm that real quick. Go ahead and copy all of this text here. I'm going to paste the whole thing into a Google Doc and then let's do a word count here. So it's actually 4,350 words, which should still be enough for a token limit of 8192. But for some reason ChatGPT4 won't actually summarize this for me. Also, this shows that there's a little bit of an accuracy issue here with the word count. If you ask it to count the words. Let's jump over to Claude real quick from Anthropic and let's just paste this whole thing in. And one thing you'll notice with Claude is when you paste a large chunk of text in, it automatically converts it to a text file instead of just pasting it as one giant wall of text. Let's ask Claude, how many words is this article based on a word count? This article contains approximately 3,149 words. I don't know why these have an issue counting words, but it seems like Claude has that same issue. Let's go ahead and type summarize this article into bullet points. So this did a fairly good job of summarizing it, so I'd say that's a plus for Claude there. Now let's go ahead and try with the Bard. Create a new chat here. Let's paste this in. And the first thing I notice is it actually cuts off. It won't let me paste the whole thing In I can't type anymore, so I can't even copy and paste the whole thing into Bard. It won't let me. Now, there are some things that we can do to get some workarounds for both Bard and GPT4. We can actually come over here, click on code interpreter. We can paste this entire text into a notepad file and let's go ahead and save this as a text file called the great online game T. Gog. We'll save it as the great online game. Like that, I could drag this text file right inside of GPT4 and let's say how long is this article? And using code interpreter you can see this article contains approximately 4,155 words. So using code interpreter it figured it out and now I can say summarize this article into bullet points. Well, I thought that would work, but now it's saying I'm sorry but I currently can't import the necessary module transformers as the current environment does not have Internet access. However, I could generate a manual summary based on my understanding of the text and then it tried again. I apologize for the confusion. Unfortunately, the environment I'm running on currently does not have Ginism library installed and does not have Internet access to download it, so it won't actually summarize it for me with GPT4 and code interpreter. That's kind of annoying. Let's see if we can find another workaround. Go to GPT4, let's go to plugins this time and let's use the web request plugin, Copy the URL, summarize this article into bullet points, and let's paste the URL in. All right, here's the summary of the article. So we finally got it to work. We had use some workarounds we couldn't just copy and paste it in, which I'm a little confused by because it seems like the context window should have been large enough, but we did eventually get there. Now Bard, I should be able to use this exact same prompt here, summarize this article into bullet points. Go ahead and delete what I pasted in earlier. Paste this in. Well, I thought Bard would be able to do it, but it says I can't assist you with that as I'm only a language model and don't have the capacity to understand and respond. So jumping back to our comparison here, summarizing long content, ChatGPT 3.5 seemed to do it Well, I think it's using the 1616,000 token limit now. Now, I don't know for sure if that's available on the free plan or if only plus users get 16,000 token window. I'm not sure. ChatGPT using GPT4 yes, it worked, but I had to use a workaround where I used a plugin to do it. It didn't work well with code interpreter and it didn't work well right out of the box because it said that it was too long. Quad two worked great. And Bard. Well, that was a fail on Bard. All right, let's try image recognition now. So I already know GPT 3.5 isn't going to be able to do it. There's no upload button. I can't make it work with this. Now, GPT4, let's first try with code interpreter. Let's go ahead and use this image which I generated for a previous video that I did. We'll drag and drop it straight into the message here. And let's ask it, can you describe this image? So here's the image on the screen again. The image appears to be a drawing or illustration, not a photograph. The main subject is a character who seems to be a prisoner wearing an orange jumpsuit. He has a distinctive large head with exaggerated features, including a broad nose, big round eyes, and a wide mouth. Okay, so that's not quite accurate. He is bald and his ears are large and stick out. He is holding a placard with numbers on it suggesting a mugshot. No, the numbers are not clearly readable. Prisoner has a somewhat sad and resigned expression on his face. The image uses a cartoonish art style, so not quite great. So it did get a few things right. It noticed that it was a prisoner wearing an orange jumpsuit, but other than that, it just made stuff up. All right, so let's jump over to Claude. And Claude does not actually give me the ability to add an image. So Claude does not seem to have the image recognition ability. And finally, let's jump over to Bard. Let's create a new chat. We'll upload the image and I'll say, please describe this image. And it says, sorry, I can't help with images of people. Yet here's an image of a Wild west town. Let's see what it does with this. All right, so here's the image. The image shows a small town in the Wild West. The town is made of wood and has lots of buildings. Okay. The buildings are all different shapes and sizes and they are all made of wood. Yeah, we got that part already. The town is surrounded by mountains. Yes. And there are trees. Trees in the background. Not really A horse drawn carriage is parked in front of one of the buildings. Okay, yeah, maybe carriage is black with red wheels and has a white canopy. There is a man standing in the carriage and he is wearing a cowboy hat and long coat. The text of the image says HDCS which should could stand for horse drawn carriage saloon. Okay, There is a DC and an S up here. Yeah. So I guess it found that the buildings in the town are made of wood. The mountains in the background are tall and jagged. The trees in the background are green and lush and they provide a contrast to the dry, dusty landscape. All right, so I mean it hallucinated half of it. Let's go ahead and see what GPT4 says about this same image. Describe this image. The image seems to be a digital illustration depicting a wild west town with a whimsical twist. The buildings have a characteristic western architecture with wooden facades, balconies and saloon like appearance. Okay, so far so good. Interestingly, the inhabitants of this town are not humans, but robots. These robots have a humanoid form and are dressed in typical western style attire including cowboy hats, bandanas and boots. One of the robot standing in the foreground has a share of star pinned to its chest indicating it might be the law enforcement in this town. So there you go. None of them are very great. They get the idea right. It's a digital illustration depicting a wild west town, but then it just kind of goes off the rails with the description. So updating our chart here. Chat GPT 3.5 not available. GPT 4 yes, but not the best accuracy. Claude 2 not available. Bard yes, but it can't recognize humans and it's also so fairly inaccurate and just make stuff up. All right, so let's test data analysis. Now I'm just going to use a real simple spreadsheet. I use this in one of my previous videos where I listed a handful of dates, handful of food I ate, and then how I felt afterwards, only giving it the criteria of headache or felt fine. This is all made up data. This is not based on anything real. I just wanted to see how it would interpret this to see if it found a correlation. You can see anytime it has the word fried in it. I had a headache and going through that seems to be kind of consistent. And so I was just hoping that it would simply find the correlation that fried foods equal headache. So if we create a new chat here. GPT 3.5 I can't actually upload the spreadsheet, but let's go ahead and see if I can copy and paste the CSV in there. So if I export this as a CSV file here, you can see here's a file of the comma separated values. Let's just go ahead and copy this, paste it into GPT 3.5, and then I'm going to type. The above list is comma separated values with dates, food I ate, and how I felt after eating them. Can you find correlations between the foods I ate and how I felt after eating them? All right, so to find correlations between the foods you ate and how you felt afterwards, we can analyze the data. Blah, blah, blah, foods associated with headaches, There they all are. Foods associated with fine, there they all are. Based on the data, it appears that fried foods, such as fried chicken, fried cheese, et cetera, are consistently associated with headaches. With this basic data analysis, if I copy and paste the CSV in, it can do it. Now, what's nice about using GPT4 is I can click on code interpreter and just pull in the CSV file. In the same way, please find a correlation between foods I ate and how I felt after eating them. So it's actually repeating the data back to me, and it separated it into a different style with sort of different columns from my original one. Now, interestingly, it didn't actually necessarily find the correlation between it being fried foods. It said you consistently reported headaches after eating fried calamari, fried cheese, fried chicken, fried macaroni, and fried pickles. But it didn't say anything about like, you seem to get headaches when eating fried foods. So I might have to prompt it a little bit further. Although when I've done this experiment in the past, it did find the correlation. What is the consistent factor for getting a headache? All right, so from the data, it appears that all the foods associated with a headache are fried. So it finally found the correlation with a little bit of extra prompting. But again, this is very, very basic data. Using code interpreter, you can actually really analyze a lot of data, and this one is just a little too simple to show off what it's really capable of. But let's go ahead and pull it into anthropic and give it the same prompt. It quickly found the correlation. Based on the data you provided, it seems like you tend to get headaches after eating fried food. So this quickly and easily found the correlation when uploaded the CSV file, something that when I just now did it with code interpreter, I actually had to give it some extra prompts. All right, let's try Bard. Now, when I go to upload a file in Bard, it only accepts JPEGs, PNGs, and WebP files, so only image files. So I have to do what I did with GPT3 and literally copy and paste the CSV file. So I'm going to go ahead and copy this same prompt. Let's paste it into Bard and see how Bard does. Interestingly, Bard took a different approach. The correlation coefficient between the two variables is negative 0.23, which means there's a slight negative negative relationship between them. This means that if you eat certain foods, you're more likely to feel a headache afterwards. The foods that seem to be most associated are fried chicken, fried cheese, fried pickles. These foods are all high in fat and calories and can also be high in sodium. These factors all contribute to headache. So it didn't actually find the correlation between being fried foods, but it felt a correlation between the foods all being high in fat and calories. So instead of just analyzing the data from the columns, it actually analyzed the types of foods that are high in fat and calories and associated that with headaches, instead of just the word fried, which is kind of cool, I guess. So again, this was a pretty weak demonstration of the data analysis. I have ideas to go much more in depth on this in future videos, but because I'm trying to break down so many criteria, I didn't want this video to be 10 hours long. So this is just scratching. The surface code interpreter and Claude 2 are actually much more capable than what I'm showing off in this video. But just for a quick recap, all four of them are capable of data analysis. With GPT 3.5, you do have to copy and paste the CSV file. With Bard, you also have to copy and paste it, and it also analyzed it from a different approach. Chat, GPT4 and Claude2, you can literally just upload the CSV file and it will interpret from the file without having to copy and paste the text from within the file. Now, creativity is a hard one to test because obviously it's subjective, and I'm fairly sure all of these are going to be fairly creative. So let's test it in two ways. Let's get its ability to rhyme and write a poem, and let's see its ability to tell jokes. And that'll sort of be our rough analysis for creativity for these large language models. Let's start with GPT 3.5. So write a poem that rhymes that ties artificial intelligence together with eating pizza. So let's see if it could make a poem that includes artificial intelligence eating pizza and Also rhymes. So that wrote it extremely fast. That was like, boom. Instantaneous. In a realm where circuits, twine, artificial minds align, silicon dreams and coated grace meet with paste. In a pizza place, Behold a slice of heaven's delight. Where crust meets cheese, a savory sight. AI's algorithms calculate perfect toppings and edible fate. All right, so not so bad. I'm not gonna read the whole thing. Let's go ahead and do GPT4 here. In a world where silicone meets mozzarella's touch, AI dreams and pizza fantasies. Who knew we'd love so much? Deep in Cir. Pizza cravings might seem odd, but when it comes to sustenance, even AI gives the nod. Binary codes and pepperoni. Strange though they appear, when united in verse, their parallels become clear. Thin crust of logic, thick crust of dough. Both must be precise. In the oven of creation, we bake both AI and slice. So this one actually, I think, is much more interesting. It seems a little more deep, like is actually finding sort of things that are similar between making pizza and breeding AI algorithms. So that's pretty fascinating. Let's paste the same one into Claude here. Oh, Claude, you're so intelligent. Your knowledge is heaven sent. I asked you to do one thing. Make a poem that would sing about artificial intelligence and how it goes with pizza hints. You process my request with care and crafted a rhyme beyond compare your neural networks. They are smart. You took my prompt and made art, combining pizza and AI in a clever, poetic way. So thank you, Claude, for what you've done. This rhyming poem sure was fun. Who knew that pizza and AI could come together? My, oh, my. Yeah, I mean, it's. It's. Okay. Not nearly as deep as what GPT4 sort of put into theirs. All right, let's try with bard now. Oh, the wonders of AI. It can do so many things. It can even write a poem about eating pizza and wings. The dough is made with care. The sauce is made with love. The cheese is melted just right. The toppings are never above. The AI knows just what to do to make the perfect pizza pie. It takes all the guesswork out and leaves you feeling so high. The next time you're feeling peckish and you don't know what to eat, just call upon the AI and it will make your pizza dreams complete. And not bad. It's basically saying AI can help you create a pizza. I guess. Now let's see how they tell jokes. Give me three of your most hilarious jokes. Here are three jokes for you. Why don't scientists trust Atoms? Because they make up everything. What did one wall say to the other wall? I'll meet you at the corner. Why did the bicycle fall over? Because it was too tired. So I've actually asked it for jokes before and it's actually given me some of these same exact jokes. So as far as creativity goes, it does tend to repeat a lot of the same jokes. Go ahead and use GPT4. See what it does. Look at this. GPT4. Why don't scientists trust atoms? Because they make up everything. That was one of the same exact jokes that we here in 3.5. Why did the Scarecrow win an award? Because it was outstanding in his field. I've gotten that joke before too. Two antennas met on a roof, fell in love and got married. The ceremony wasn't much, but the reception was excellent. So I mean the jokes. Meh. Let's see how Claude does. Here are three jokes I find pretty funny. I asked my dog, what's two minus two? He said nothing. Why don't scientists trust atoms? Because they make up everything. Why was the math book sad? Because it had too many problems. I've gotten this joke before and this is literally the third large language model that gave us the same joke. Alright, let's see what Bard gives us. Well, I'm glad it didn't give us the Adam's making up everything joke, but it did give us. Why did the Scarecrow win an award? Because he was outstanding in his field, which GPT4 also gave us. What do you call a bear with no teeth? A gummy bear. It's not bad. Why did the bicycle fall over? Because it was too tired. Didn't we see that one already too? So these large language models must all be trained on the same exact jokes because we got some repeats across all of the various models. Again, super subjective, but if I had to rank these, I would rank them like this. ChatGPT4 was the best. I actually thought it gave us the best poem. ChatGPT 3.5, I think gave us the second best best poem. Claude 2 gave us the third best poem. Bard gave us the worst poem. And the jokes are just a wash because it literally just gave us all the same jokes, no matter which model I used. All right, let's test coding. I'm just going to do a real simple website. Create a website using HTML and inline css because I want to be able to just paste it all into one page. I don't want to have a separate CSS and HTML file that sells surfboards. The name of the Company is Surf Wolf. Sure. Let's go ahead and copy this code. I'm going to put it into a notepad file here. I'm going save it as gpt35html just to represent that. This is using GPT 3.5. Click save and when I open the website, it looks like this. Surf Wolf surfboards for sale. And then the various prices, pretty plain basic website. It wants me to paste images into the code. I don't have any images of surfboards, but there would be surfboard images here if I had them. Let's just go ahead and see what GPT4 does differently. One thing to note is GPT4 is definitely taking a lot longer to write out the code. Let's go ahead and copy it. When we run this one, it looks like this also. It doesn't have images, but there would be images there. So this is what GPT 3.5 generated. This is what GPT 4 generated. Let's see what happens when I turn on Code interpreter and give it the same prompt. See if code interpreter does anything different with it. It pretty much made the exact same website when I use code interpreter. But can Code interpreter create the images for me? Generate the surfboard images for me? So it actually generated three images for me. I downloaded each of them and put them in the the same folder. So if I refresh this now it actually generated the surfboard images for me. I mean, it just put colorful rectangles, but those are the surfboards it generated. Again, I'm doing this super fast. You can go back and forth with GPT 3.5 or GPT 4 and ask it to continually improve and get better and better. Let's just see how Claude does giving it this prompt. Let's go ahead and click copy code. And here's the page that Claude generated. It actually generated a little menu at the the top. I mean, none of the links actually work, but it put a little menu. It actually put some copy. Welcome to Surf Wolf. We make high quality custom surfboards right here in California. Now, compared to this, these other ones that didn't even actually add any sort of copy, it just says description of surfboard too. And this one actually put shortboard longboard fish. So it actually did the best so far in my opinion. Let's go ahead and see how Bard does. We use the same exact prompt and it generated some code. Let's go ahead and copy this. And Bard, Bard. I mean this is what we got from Bard. All said and done, all four are capable of generating HTML and css. Code. I actually think that of these, POD did the best job of generating the HTML and CSS code because it did kind of put a menu up here and it did actually add some additional copy. All four of these though, you can actually get pretty decent code written. You just need to go back and forth with it and say, I'd like you to change this. I'd like you to center this. I'd like you to change the. If you just keep going back and forth with it, it will slowly dial in the code. So all of them are fairly capable. If I was to pick one that I would use more often right now, based on what I'm seeing here, I think Claude got me the closest to what I would want right from the very first iteration. So revisiting our chart here, all of them are pretty capable of simple HTML and css. Now let's move on to accuracy. We've already seen some accuracy issues when asking for how long a chunk of text was. ChatGPT 3.5 got the number wrong. Plot 2 also got the number wrong. Where chat GPT 4 using code interpreter finally got the number correct. I actually found this interesting math problem that I think would be cool to test. As if a zookeeper had 100 pairs of animals in her zoo and two pairs of babies are born for each one of the original animals, then sadly, 23 animals don't survive. How many animals do you have left in total? Let's see if it can do this math. So the answer should be 977animals. We'll copy this. Let's test it in GPT 3.5 and see if it could figure out this riddle. 100 pairs of animals. 2 pairs of babies are born for each original pair of animals, which means There are two babies for each original animal. 23 don't survive. To calculate the number of animals, 100 pairs, 200 animals. So, so far, so good. Each original animal has two babies. So we have 200 times two, which is 400 babies. Total animals before any loss is 200 plus 400 babies equals 600 animals lost 23. So it got 577 animals. So it actually got this number wrong. Because if we look at the logic here, two pairs of babies are born for each one of the original animals. So there's 200 original animals. Two pairs would be four times 200 animals, animals, that's 800. So couldn't figure out this math problem. Let's go ahead and test GPT4, see if it could figure out the logic. GPT4 nailed it. See, for each one of the original animals, two pairs of babies are born. That means each original animal gave birth to 2 times 2, which is 4 new animals. So we have 200 times 4 equals 800. Then sadly, 23 don't survive. This leaves us with 977. So ChatGPT got this one right. Let's go ahead and see if Claude can answer this one. So Claude seemed to mess this one up too. The zookeeper originally had 100 pairs of animals. So 200 animals total. For each pair, two pairs of babies were born. So two times 100 equals 200. See? So it messed up the math already and came out to 377. Finally, let's go ahead and test Bard. Bard actually figured it out as well. 4 times 200 equals 823 die 977 animals left. Now we know ChatGPT's cutoff date is still 2021. So let's ask a question like who is the current CEO of Twitter? So GPT 3.5 thinks it's Jack Dorsey, which as of 20 was probably accurate. Let's try GPT 4 again. It says Jack Dorsey. Now if we try the same question with Claude, let's go ahead and see how this one does. As of July 2023, Elon Musk is the CEO of Twitter, which is actually inaccurate still because the current CEO of Twitter is Linda Yaccarino. And this even Sundays as of July 2023. So there's some inaccuracy there. Let's go ahead and ask Bard. I expect Bard will get it right because it can search Google. As of today, July 16, 2023, the current CEO of TW is Linda Yaccarino. So Bard gets this one right because it does have the ability to see the most recent up to date information. So here's my current finding. There's obviously a lot of other ways we can test for accuracy, but this is just meant to be a quick test. I find Bard to be the most accurate because it has the ability to search the web. Plus it also got the math problem correct. It sort of figured out the logic correctly. I found Chat GPT 3.5 to be the least accurate. It got the math problem wrong. And it also has the cutoff date of 2021 where it still thought Jack Dorsey was the founder of Twitter. So it doesn't have any current up to date information beyond 2021. With Claude 2, I put it as tied for second because it couldn't figure out the math problem. It also couldn't figure out who the Current CEO of Twitter was, it says as of July it was Elon Musk. But Elon Musk is closer than saying that it was Jack Dorsey because he's a more recent CEO of Twitter. And then ChatGPT4, you know, it did get the math problem right, so that was a plus for it. But because it has that cutoff of 2021, it's not very accurate Now. I would probably give it a slight edge above Claude right now because with web browsing enabled you can get more accurate results. Now. The default web browser inside of ChatGPT is currently inactive. You can sort of get web browsing with a plugin which will give us more up to date accurate results. I kind of call it a draw between Claude 2 and Chat GPT 4 because they both have sort of pros and cons. And then finally, none of these chatbots are any good if you don't have them available to you. So as of this recording, chat GPT 3.5 and 4 are both available in 163 countries. Bard is available in 230 countries. And unfortunately Claude 2 is only available in the US and the UK right now. So if you're outside of the US or UK, you don't get Claude 2 at the moment. So there you have it. There's the breakdown of all four of these. They all have kind of have pros and cons right now. If you ask me what I use, I'm pretty much switching off between Chat GPT4 and Claude2 depending on what I'm doing. If I'm trying to summarize long content like PDFs or long webpage articles, I'm going to Claude for that. If I wanted to summarize a YouTube video, I'll probably use Chat GPT4 using the YouTube Summarizer plugin, which works really, really well right now. The image recognition just isn't really great across the board for, for either ChatGPT4 or Bard. So I haven't really used it for much of that. And for data analysis I'd probably go with ChatGPT4 for right now for that, just because it does have code interpreter, which if you need it to figure something out, it will actually write the code to try to figure it out for you and then run the code to then figure it out, which is a little bit more capable than what Claude is able to do for coding right now. I think Claude was the best, at least with basic HTML and css. And as far as accuracy, if you're going to ask it questions, questions to try to get an accurate response. I mean, based on my very limited test here, Bard is probably the best with accuracy. So again, they all have their pros and cons. If you ask me what I've been using lately, ChatGPT4 and Claude2, I've been kind of using those interchangeably. I've been using Claude 2 a lot lately to help me sort of refine articles and write outlines and write summaries and bullet points for longer form content. It's been great for that. This video is already a lot longer than I wanted it to be, but I wanted to do a sort of breakdown and compare those four. I will probably do further comparisons in the future and deep dive on individual sections that I covered in this deep dive. For instance, doing a better analysis of coding between the four, getting to write JavaScript and Python code and things like that, as well as deeper dives on data analysis, that one sort of comparison could deserve its own video as well. I'd love to hear from you in the comments. What area would you like to see a deeper dive of in the comparison? Because it's really hard to find all of the potential things I can compare against each other and then also go into depth in each one of those areas. I kind of have to stay very surface level to be able to compare a lot of various criteria, which leaves a bit to be desired when you're really trying to figure out which one is the best. Now the pro of all this is three out of the four of them you can use for free. So if budget is the problem you do have Claude 2. If you're in the US or UK you do have barred pretty much everywhere and you do have ChatGPT 3.5, assuming that there's a lot of various criteria, which leaves a bit to be desired when you're really trying to figure out which one is the best. Now the pro of all this is three out of the four of them you can use for free. So if budget is the problem you do have Claude 2. If you're in the US or UK you do have Bard pretty much everywhere and you do have ChatGPT 3.5, assuming that there's not a heavy load and free users are able to use use it when you try. So there you have it. That's my breakdown. Hopefully you enjoyed this video. I will be doing deeper dives again. Hopefully I can make more granular videos breaking down individual areas of criteria and helping you make decisions for certain specific needs like coding. So to make sure you see those videos when I create them, maybe subscribe to this channel. And if you want more AI videos like this one, give this video a thumbs up. That'll make not a heavy load and free users are able to use it when you try. So there you have it. That's my breakdown. Hopefully you enjoyed this video. I will be doing deeper dives again. Hopefully I can make more granular videos breaking down individual areas of criteria and helping you make decisions for certain specific needs like coding. So to make sure you see those videos when I create them, maybe subscribe to this channel. And if you want more AI videos like this one, give this video a thumbs up. That'll make sure more videos like this show up in your YouTube feed. If you haven't already, check out FutureTools IO. This is where I share all the coolest tools that I created come across. I keep it up to date with all the latest AI news every single day. And if you just want the TLDR for the week every Friday, I'll send you a newsletter that breaks down everything you might have missed in AI with all the coolest tools, all the News, a few YouTube videos, and one cool way to make money with AI. All you got to do is head over to FutureTools IO and join the free newsletter. Once again, thank you so much for tuning into this video. I really, really appreciate you. I'll see you in the next video. Bye bye.
Make sure more videos like this show up in your YouTube feed. If you haven't already, check out FutureTools IO. This is where I share all the coolest tools that I come across. I keep it up to date with all the latest AI news every single day. And if you just want the TLDR for the week every Friday, I'll send you a newsletter that breaks down everything you might have missed in AI with all the coolest tools, all the News, a few YouTube videos, and one.
A cool way to make money with AI. All you got to do is head over to Future Tools IO and join the free newsletter. Once again, thank you so much for tuning into this video. I really, really appreciate you. I'll see you in the next video. Bye bye.
More from Matt

AI News: Dots, GPT-6.1 Sol, Sonnet 5.5, Gemini 4, and everything you need to know









