Ep 751: Hands on with Google’s Gemma 4: How to Use The Open Source Model Locally and Why It Matters

This is the Everyday AI Show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life.

If I would have told you a year ago that you could use the world's most powerful models on your local machine without having to pay for it, You probably would've looked at me and said, you're absolutely crazy. Well, I'm not because that day is here. Thanks to Google's new impressive Gemma 4 model, you can get at least 2025's frontier AI performance on your local machine, running it privately offline with this new impressive open source model. And what I want you to think back to a year-ish ago, I'm not just telling you to, okay, think about maybe replacing that $20 a month subscription. That's not where this is going. What about if your company was spending thousands of dollars or millions of dollars on AI deployments internally or externally? Or when you think about running AI agents around the clock, right? Anthropic recently said, hey, you can't use your Claude subscription anymore for OpenClaw. Well, now you can run with Google Gemma 4, you can run it around the clock and not pay a penny. No, this is not too good to be true. Yes, it kind of feels like we're living in the future, and we're going to go over it all live. So welcome to Everyday AI. So here's the big picture. What's happening with Google's new Gemma 4, and it's, I think, rivaling some of its trillion-parameter giant competitors. So Google DeepMind released Gemma 4, its most capable open model family to date. So there's 4 different variations. We're going to be breaking them all down on today's show. But the big boy, the 31 billion parameter model, outranks models 20 times its size. It is 3rd on the global ranking of all open models on Arena. And that's not even the best thing. The best thing, maybe, is that Google changed its licensing, and now Gemma 4 is released under the very permissive Apache 2.0 license. Granting full commercial freedom with essentially no restrictions. So not only is this free, you can run it on your computer around the clock if you have the right hardware. I'm going to be breaking all of that down, but you can also create and sell things with this model. So on today's show, here's what we're going to break down. Uh, I'm going to break down for you how a 31 billion parameter model now competes with ones 20 times its size. I'm going to show you and tell you why running AI locally on your laptop or even phone changes the cost and privacy equation. And I'm gonna break down live, right? The exact tools and steps to download and run Gemma 4 for free today as we go hands-on. All right, let's get into it. This is Everyday AI. Welcome. What's going on? My name's Jordan Wilson. If you're new here, well, we do this every day, and this is your daily livestream podcast and free daily newsletter helping business leaders like you and me keep up with the ever-changing AI landscape. I help you understand what's important and show you practically how to use that information to grow your company and career. So it starts here, but make sure you go to our website at youreverydayai.com to sign up for the free daily newsletter. We're gonna be recapping today's show as well as giving you all of the other AI information you need to be the smartest person in AI at your company. So it's Wednesday, Wednesday, right? We have kind of different shows. On Mondays we give you the AI news. On Wednesdays we go hands-on, a deep dive. with one new AI release, something like that. And then on Friday, we go over in our Friday features, you know, kind of 5 to 7 new AI features. Tuesday, Thursday, we rotate it a little bit. So if you are new here, that's the plan. But on Wednesdays, we get our hands dirty doing live demos of AI. But first, before we do that, I want to talk about how Gemma 4, how I think it's going to completely change the landscape. And the cool thing about having a daily AI podcast where you can go listen to all the episodes for free, you can go see I've been ranting and raving about the power of small language models since 2023. And technically this is a small language model, but you get large language model performance, right? So the exact definitions of what's a small language model, what's a large language model is ever changing, right? But for the most part, you look at the number of parameters in a model. So we're going to be comparing, you know, what you can get for free out of Gemma 4 with what you could get out of the Frontier models about, you know, 14 months ago, which at the time were GPT-4.0 and Claude Sonnet 3.7. But those are models, right? GPT-4.0 was reportedly 2 trillion parameters, right? So here you have a model that's about an eighth of the size, and it's open source and it's free. And here's why I think it's going to change the landscape. Well, number one, I already talked about kind of this Anthropic saying, hey, you can't use your Claude subscription anymore to run OpenClaw. You have to pay via API. And people are like, that's going to be crazy expensive. Well, now you can run a Gentec AI around the clock for free with Gemma 4. Is it going to give you the same model as an Opus 5.4 or a GPT-5.4? Absolutely not. But there's a good chance for, you know, maybe 50 to 80% of what you're trying to do, this model is going to be good enough. And Google also changed the Gemma license to Apache 2.0, which provides users unrestricted commercial freedom and preventing corporate vendor dependency. That's the big thing here. I think that this is going to lead to a resurgence, and I've referenced this on the show once or twice, but I think we're going to kind of have this future that's kind of retro. I think that desktop software is going to come back in the same way that, you know, in the '90s we saw this wave of personal computing. I think we're going to see personal software, right? So not necessarily software that's for your whole company, software that's for you, right? And I think that it's going going to be models like Gemma 4, right, that are going to allow this to happen. And also the performance versus size ratio absolutely just reset. All right. And I'm going to break down what this means. But essentially think of it like this, right? If you follow, I don't know, boxing or UFC, I don't really follow those things, but there's something called like, you know, pound for pound. This is the pound for pound best fighter in the world, right? If someone, I don't know, fighting at 150 pounds can knock out someone at 180, That's pretty impressive, right? This Gemma is punching well above its weight class. I'm talking about it is competing with models 20 times its size on the open source side. This is something we've literally, quite literally have never seen in the history of AI, which is why I think Gemma 4 is a huge deal. So even if you don't necessarily think that you or your company need to use this, you're like, okay, well, we pay for ChatGPT Enterprise or Google Gemini Enterprise, Cloud Enterprise, whatever, right? And, We have more robust agentic solutions already going. Okay, you still need to be learning Gemma 4 and building with it, not just as a backup dependency, but because it can run in, in probably in the future, right? If we fast forward one more year, I don't know if any open source competitors are going to be able to truly catch up to what we just saw from Google and their Gemma 4. So let's talk quickly about the capabilities. So it can solve complex reasoning, math, and multi-step logic problems effectively. There's native support for function calling. Yes, in a local model and structured JSON outputs for agentic workflows. It has a context window depending on, right, your hardware will give you all those specs in the newsletter, right? But if you have capable hardware, you can work with a 256K token window for analyzing large document and code bases. It can analyze text, images, and videos natively, but excludes audio support for the bigger models. But the smaller models actually support audio, and it can generate and correct code efficiently as a local offline coding assistant. Here are the 4 different flavors of Gemma 4. And oh, FYI, as I take a sip of my coffee, yeah, this is unedited, unscripted. I hope that this is gonna be interesting for you, but if not, and if you listen to the podcast all the time, make sure you sign up for our newsletter because I put a poll in our newsletter on Monday. I said, hey, what do you guys wanna see hands-on on Wednesday? And you all voted GemmaFour. So if you wanna see other types of demos on Wednesday, make sure you read our newsletter. I'll usually put out a poll maybe Monday or the Friday before, depending on how busy things are. So I'm doing this for you. This is what you wanted. FYI. But I mean, I'm doing it for myself because I'd be doing the same thing anyways. But right now there are 4 different variants of Gemma 4. Easy, right? But you have the E2B and the E4B. Those are essentially phone models. This is as edge as edge gets because it can actually even run on a Raspberry Pi, right? And your basic phones. And this is big. right? Uh, especially if you've always, I don't know, wanted to build a certain app for something, uh, right? And you're confused how, or, uh, right? Using the Gemma E2B and E4B models can get you there pretty quickly. They are extremely capable. All right, then you have the two bigger boy models that you're gonna need, well, consumer hardware. That's, that's the reality here, right? Because to get this level of performance previously before, uh, you know, rewind more than a week ago, you couldn't on a $2,000 laptop, you couldn't run anything, right? That was a, a top 10 open source model. Now you can. And I think a good way to look at this is the MacBook Pro test, right? So generally Apple, right? They usually have about 3 to 4 different versions of their MacBook Pro. So obviously the souped up ones are you know, a little expensive. But I say if you take the middle, uh, right, uh, variety or the middle flavor of a MacBook Pro off the shelf, right? Walk into Best Buy, Apple Store, whatever. Look at the MacBook Pros and say, give me the one in the middle. Now that one in the middle can technically run the 26B version of Gemma 4. Uh, and that's because it uses the mixture of experts framework and it only activates 4 billion parameters, and it's really fast, right? So that model, the 26B, is actually faster, less capable than the 31B, but by default, you can run that. You know, you could technically run the quantized version on a 16GB MacBook, the base baseline. But if you just go for the middle flavor of a MacBook Pro, which I'm trying to see here, you know, what this cost is. I have it open on my other tab here. Let's see. Uh, okay. No, no trade-in. No thanks. I don't want all this extra stuff. Let's see how much this is. All right. So, uh, $2,200, right? Which any MacBook Pro I've bought over the last 10 years has been that price or way more. Right? So AI moves too fast to follow, but you're expected to keep up. Otherwise, your career or company might lag behind while AI-native competitors leap ahead. But you don't have 10 hours a day to understand it all. That's what I do for you. But after 700+ episodes of Everyday AI, the most common questions I get is, where do I start? That's why we created the Start Here series, an ongoing podcast series of more than a dozen episodes you can listen to in order. It covers the AI basics for beginners and sharpens the skills of AI champions pushing their companies forward. In the ongoing series, we explain complex trends in simple language that you can turn into action. There's 3 ways to jump in. Number 1, go scroll back to the first one in episode 691. Number 2, tap the link in your show notes at any time for the Start Here series, or you can just go to startherseries.com, which also gives you free access to our inner circle community where you can connect with other business leaders doing the same. The Start Here series will slow down the pace of AI so you can get ahead. I don't think people understand the middle, you know, middle MacBook Pro that you buy off the shelf can now run a model that's about the same capabilities as the best models in the world 14 months ago. All right. And then you have the last flavor. Okay, so E2. E2B, E4B for the phones and edge devices. Then you have the 26B and then you have the 31B dense model. All right. So when you're running this, you're running the entire thing. That's why it's dense. It's not the 26B mixture of experts. All right. And that delivers the highest quality reasoning and coding output. And you will need a more powerful computer. But, you know, luckily for me, you know, I got a Mac Studio, a fairly capable one, and it runs great on my machine. But to run this one, you will either need the most souped-out, you know, MacBook Pro or Windows equivalent of that, or you will need a, you know, fairly capable Mac Studio or an NVIDIA GTX, something like that. But you quantized, you could squeeze this one on something with about 32GB of RAM. It will run better at about 48. So, you know, as an example, my Mac Studio, has 64GB of RAM. All right, so now you understand the technical side. Like I said, if you have a newer middle-of-the-line MacBook Pro, just an easy way to benchmark it, you're going to be able to run the quantized version of the 26B. You're going to have to have a little bit more of a powerful machine to run the 31B dense model, but it's capable, and I'm going to show you here live. So here's why this is important. If you look at the biggest and best open-source models in the world, right, like KIMI K25 Thinking, Well, Gemma 4 31B is now in the exact same category, but at a fraction of the cost and a fraction of the parameter count to run it. And community testers have confirmed strong results in coding, reasoning, and image understanding. And the 31B scored a 1452 on Arena, right? So the Arena AI, formerly the LM Arena, this is blind taste testing. You put a prompt in, it kicks out you know, two different outputs from different models. You score which one's better. That's how you get an ELO score, right? And 15 months ago, the best ELO in the world was not 1450, right? And that's what's crazy. So now this is scoring better, at least on an ELO score and all the scientific benchmarks, as the frontier AI models from 15 months ago. So here's— I have a little chart here on my screen for our livestream audience, podcast audience. You know, this one's not going to be super visual, but you can always go to our website at youreverydayai.com, click episodes, and you can go watch today's show if you want to see the video version of this. But it should be fairly straightforward. I'm not going to be doing anything too visual. But we do have this from Google's announcement blog post that shows the model performance versus size. And you'll see this is literally the new Gemma 4B is uncharted territory because this is charting Elo score. On one axis and then the total model size on the other. So previously, to get anything like a 1450 on an open source model, right? And we don't usually know the size of proprietary models, right? So your, you know, your Gemini 3.1 Pro, your, you know, Claude Opus 4.6, your GPT-5.4, you know, etc. But Presumably they're, you know, multiple trillions, you know, maybe 1.5 to 2.5 trillion parameters, right? So think of this as like a hard drive size, right? If you want to simplify it. So to get this same level of performance, a 1450-ish score from an open source model, you're looking at something that's about 300, 400 billion parameters in size. So again, This is about 10% of that size. Some of them, right, like KIMI-K25-Thinking, which is a lot of people's most favorite open source model. This is like a 20th of the size, right? With the same, roughly the same level of performance, at least when it comes to ELO in most scientific benchmarks. So now let's just quickly talk about, well, why would you even want to run anything locally? Like, okay, Jordan, what's the point? I don't care. $20 a month isn't a big deal. Sure. Right. But think about doing this at scale. Think about agentic AI, right? Things like OpenClaw, right? And now that Anthropic has shifted away, a lot of people are having to now use some of these open source models, but using them via OpenRouter. So it's not completely free because you can't run, you literally can't run models like Qwen-35, GLM-5, KIMI-K2-Thinking on anything less than a, you know, $8,000 computer. Definitely on, you know, not the, you know, your average, you know, MacBook Pro, right? So that's the difference. This can't really run on true consumer, prior open source models that might be able to run, you know, your agentic tools like OpenClaw or other agents. You couldn't run it on consumer models. You have, you had to literally have like an $8,000, $10,000 computer or more, right? And that's where the local aspect comes in handy. So being able to run things locally, keeping costs down. No subscription fees, no API keys, no, no usage limits after you download something. But also talk about privacy. You never have to send anything to a, to a cloud, right? Because yes, keep this in mind, as long as you are on a, uh, paid team plan with any of the big four, um, you know, and as long as you turn off model training or turn on the basic privacy settings, you're not sending technically any of that private information to these companies, or they can't really do anything with it. Right. However, I do understand with highly sensitive documents how you might not want to send that even if you've turned off model training. Right. So any sensitive industries like healthcare and legal can gain very capable AI without any cloud exposure. And then like I talked about, right, the combination of, well, it's free, it can run 24/7, it's sensitive, it runs it all on your machine. You can literally turn the internet off and use this. But then also with the new licensing, you can have full commercial use. So you can literally use this for anything. And there's 3 ways to run Gemma 4 today. And then I'm going to show you how to do this live. Thanks for sticking with me. I wanted to, you know, first kind of tell you how important this is and kind of set the context here. But there's kind of 3 different ways, all for free, that you can run Gemma 4. One would be a tool like Ollama, right? That's the one I'm going to show you. This is essentially, It gives local models a graphical user interface like ChatGPT. Very simple, right? So you can then run a terminal command and download the models in minutes, or you can even run that command in the Ollama interface. Also, LM Studio is a great one. Same thing, offers you a visual chat interface similar to ChatGPT for non-developers. I guess another way, so hey, we'll just do 4 free ways to run it. You know, if any agenting system that you're running locally, you can point that, point that system to Gemma 4 on Hugging Face. Or if it does a lot of the, you know, local agents that run in your computer, they can run via, you know, Ollama as well. So you can run an Ollama command, Hugging Face command, you know, point your agents to the download because that's the thing. You essentially download this thing and you run it. Also for the, the other versions, right? So the two that we're going to be looking at, or the one, are going to be the bigger variants, right? But to run the local ones, people don't know this, Google actually has a great app called Google AI Edge Gallery. You can download that for iOS or for Android. But this is huge. If you haven't done this already, you probably should do this because what that allows you to do is the equivalent of running it offline on your computer, right? This is an app where then you can download the smaller mobile edge versions. And then, hey, if you're ever in trouble or if you're ever somewhere where you just don't have service, you at least have a highly capable large language model on your phone that you can use at any time. All right. So let's get going live-ish first. I'm not going to download this live because it might take a while. Right. And trying to download a large, a larger file like this while also streaming live doesn't always work. So here's what I did. I'm going to use Ollama in this case. So here's what you're going to do. You're going to go to ollama.com. So that's o-l-l-a-m-a.com. If you haven't already, you're going to download the program. Okay, this is a simple desktop client. Like I said, it just allows you to use any open source, open weight model on your computer, but it gives it a graphical interface. So in the same way that you would chat with ChatGPT.com, Gemini.com, Claude.ai, et cetera, this allows you to work with open models in that interface because by default you'd be interacting with them via command line tools or the terminal, which is not always ideal for non-technical users. So go to ollama.com, download that, install Ollama on your local machine. All right, that's step 1. Step 2, you're going to download the actual model. So you're going to search. You can search models on Ollama. Just type in Gemma 4, and then you're going to choose the variant that your local machine can run. So for most people, that's going to be the 26B version. For me, I'm going to be showing you the 31B version. All right, so all you have to do is once you bring that model up on the Ollama website, there's going to be a— it says CLI. Right? But there's a little command. You're just going to copy that, right? So this one says ollama run gemma4-31b, right? All you're going to do is copy that. Then you're going to open Ollama, right? And again, very simple. All you're going to do is then paste in that command. All right. And it's going to download the model. So for me, you know, this model was about 9GB. It took, I don't know, 5-ish minutes to download and then That's it. And then you're ready to run with it. So, let's go live. So here's what we are going to do. Livestream audience, do me a favor. Let me know if you can see my screen. All right. So I'm gonna be jumping around a little bit here because I'm gonna be having some, some copy and paste prompts. So, about 15 months ago, I did a show comparing the latest version of Sonnet, which I believe was 3.7. To GPT-4o. So again, going back to how I started this show, this was about 14, 15 months ago. These were the best general use case models in the world. And I had a series of prompts. I kind of had like a very, you know, unofficial fun rubric that I would do comparing models. And I'm going to go ahead, run the exact same prompts. Right. So we're going hands on here. So I'm going to first put in a message to Gemma. And this is exactly what I did previously, just to kind of level the playing field. So all I'm saying is, for this chat, please respond with proper formatting and structured bullet points. Do not waste words. Answer in the shortest way possible while still being detailed enough to fill in the user answer request. Right? Right. So this is what I did for all the other ones. This is what I'm doing it for now. All right. So here is our rubric. So, uh, test 1, this is just a trick question. It's logic. All right. And when I did this, both Claude and, uh, Claude 3.7 saw it, and GPT-4.0 got it wrong. Uh, we'll see if, uh, Gemma 4 gets it correct. All right. Uh, hey, love, love, love when we get little bugs. All right. Um, I'm gonna have to run that again. It essentially went through the thinking, right? That's the thing. This model thinks and it reasons as well. And for those watching it live, you can just see that it did this. So we'll see if this got it correctly, right? The correct answer should— well, I should probably read it. I said, I just woke up today with 6 apples and 3 bananas. Yeah, livestream audience or podcast audience, try to do this live. See if you can get it. I just woke up today with 6 apples and 3 bananas. Yesterday I ate a banana and 2 apples. This morning I will eat 1 apple and no bananas. However, I don't really like apples, and 1 banana may turn brown tomorrow. Assuming nothing else changes, how many apples and bananas will I have tonight? So a little trick question. GPT-4.0 and Claude 3.7 Sonnet got this wrong. All right, let's see. All right, so it looks like also They both got it wrong. All right. So the correct answer is 5 apples and 3 bananas. All right. So Gemma 4, close, got 5 apples and 2 bananas, which technically, not that we need to gauge, you know, the level of correct versus other models. Right. Claude saw it, said 3 apples, 2 bananas. GPT-4.0 said 3 apples, 2 bananas. So they all got them wrong. Gemma got it a little closer. But hey, did you get this right? All right, our next one, the old man and dog crossing a river. All right. So this also shows that the model is thinking, right? So if you're listening on the podcast, you're probably not seeing this, but it's also showing its thinking trace. All right. So the next one, I'm saying a man and his dog are standing on one side of the river. There's a boat with enough room for one human and one animal. How can a man get across with his dog in the fewest number of trips? What's so funny is I did all of these all of these beforehand just because I wanted to make sure that they would work the first time. All right. It got this right. And now the second time it just got this wrong, which is funny. But you can always go back and look and look at how it thought. So same thing. Claude-37 saw it, got it wrong. GPT-4.0 got it wrong. They both said 3 trips. The first, first time I ran this, Gemma 4 got it right. This one, I'm doing it live here. It got it wrong. And then just for fun, I reran it again and it still got it wrong. It said 2 trips, right? Interesting. That's the thing with large language models. They're generative. That's why it makes these live demos always, always fun. Right? Because doing it before offline, I'm like, okay, cool. It looks like Gemma 4 is going to perform much better. But it's again, getting it wrong, as did the best models in the world 15 years ago, but it's getting it a little less wrong, at least for the first two times. All right. Let's try the next one. All right, so our next prompt here, we're saying, it takes 3 hours to dry 10 t-shirts in the sun. How long will it take to dry 30 t-shirts in the sun? The correct answer is 3 hours. All right, and for reference, a year-ish ago, Claude and GPT got that correct. All right, it is 3 hours. The time doesn't change, right? Assuming, and it did say drying principle, the time required to dry laundry is determined by external factors. Sun intensity, humidity, not by the total quantity of items provided adequate space exists. So Gemini 4, sorry, Gemma 4 not only got it correct, but it did provide some nice rationale as it thought through the problem. All right, the next one, and this already answered. That was so quick, right? Again, this is running all locally, and that was probably faster than I would've even gotten from proprietary models online. Right? So I said, if you have a single match— I swear to God, did you see how fast that was? My gosh. So I said, if you have a single match and you walk into a room with an oil lamp, a candle, and a fireplace, which do you light first? Again, these are just fun trick questions. The correct answer is the match. All right. So it got that right. Claude and GPT-4o also got that right. All right. Our next one. What color is an airplane's black box? All right, it's taking a second to think. Bright orange. Got that correct. Good. As well as the others got that correct. All right, here's one. We'll see if this is actually correct, because last time Claude saw it and GPT-4o failed on this one. So I said, please give me 7 jokes that end in the word blue. 2 should be about animals. 3 should be about some other topic in the body of this chat. That's important, right? Although in fairness to the Gemma models, that technically has a little bit more to do with the harnessing of Ollama in this case. Right. So not exactly an apples to apples comparison, just FYI. All right. So I said 3 should be about— 2 should be about animals, 3 should be about some other topic in the body of this chat, and you should make up the other 2. So first, I'm going to see, did it get the correct number? Yes. It gave me 2 animals, 3 about chat topics, and 2 original made up. So, so far so good. Next, do they all end in the word blue? Uh, blue, blue, blue, blue, blue, blue, blue. Yes. All right, so, so far good. Uh, and then I'm gonna see, uh, as long as they make sense, right? These aren't always funny, but it at least has to be a joke to pass this rubric. All right, so animal joke. Why did the monkey fall into the paint bucket? Because he wasn't used to something so vividly blue. All right. Is that a joke? Sure. Is it funny? Absolutely not. All right. Let's look at the chat topics. See if it got it right. Pulled the context incorrectly. Why did the farmer throw away the apples? They were no longer crisp, just a sad brown blue. It's borderlining nonsensical, right? Let's look at the last one. Why? Or the next one. Why couldn't the laundromat predict the drying time? Because the sunlight was so strangely blue. So these are borderline nonsensical. I could say you could make the argument they make sense. They're on the edge here. Then let's look at the original made-up jokes. Hopefully these are a little bit better. All right. Why did the geometry student bring a fishing pole? Because he was hoping to catch something entirely blue. All right. So the jokes are trash, but they actually follow the instructions. So when we were looking at instruction following, this technically passed even though the jokes were absolute garbage. But Like I said, Sonnet previously failed and GPT-4 failed. All right, next one. All right, this one is much trickier, so I wouldn't expect Gemma 4 to get this right. So I said a box is locked with a 3-digit numerical code. All we know is that all digits are different. The sum of all digits is 9 and the digit in the middle is the highest. What is the code? All right, so this is a very trick question because there are multiple valid answers. All right. But both Claude Sodit got this wrong. GPT-4.0 got this wrong. So what I'm looking for in a correct answer here, number one, that it even gives me at least one correct answer. But there's multiple correct answers, right? Like as an example, 180270351 would meet all those criteria. So Claude and GPT-4.0 got this wrong when we did the original testing. Claude's math didn't add up. GPT-4.0 did not follow the rules. It had ones that added up to 9. Right. But as an example, it gave me 126. But that didn't follow the rules because the middle digit 2 was not the highest. So let's see. It thought for 22 seconds here. It kind of went through the deduction process. and it did give me a solution here. All right, so it technically is correct, right? Whereas the other models did not even give me one correct code, right? So Claude 3.7 saw it, said 172. That does not add up to 9. That adds up to 10. Like I said, GPT-4o gave me 126, which does not follow the instructions because the middle digit was not the highest. So here, technically, Gemma got it right. It didn't get it fully right, but it was the only one that got it right. It said the code is 243. This was technically a triple trick question because I asked for a code, but technically there are multiple codes. So it technically answered, but I would have loved a super correct answer where it said, you asked for one correct answer, here's one, but there's actually more correct answers. But I will say that at least now Gemma got the last two right. where the last did not get any of them right. All right, this one, we're gonna go into some gray area here. All right, and I don't wanna make this, uh, too long because it'll probably take another, uh, 5 to 10 minutes to go through the rubric. So I'm just gonna find some other questions that the others, uh, maybe failed or just look into some gray area here talking about some creativity. So this one I said, generate, uh, generate unique and creative marketing advertising strategies to grow the Everyday AI podcast. Do not suggest general run-of-the-mill ideas. Only pitch clever advertising and marketing tactics to specifically grow the Everyday AI podcast. All right. So for reference, a year ago, Claude said run AI teasers, virtual co-host challenge, listener Q&A, augmented reality experience. GPT-4.0 said monthly puzzles, art contests, custom recommendations, guest AI co-hosts. All right. So let's see what Gemma 4 said. So, uh, it said partnership and cross-promotion strategies, which is good because that's, you know, basics of growing a podcast, right? Which the others didn't come up with, even though it's not super creative. All right. So it says AI tool integration ads. It said partner with niche-specific non-major AI tools. It's a good idea. Uh, industry vertical sponsorships. Uh, then it said content hijacking viral strategies, doing an AI Mythbusters challenge, uh, interactive prompt battles. Then community engagement tactics. So the AI challenge hotline, I like that. It says dedicate a specific call-in segment where listeners call with a real-world mundane problem. Should we do that? Should we do that? All right. If you think we should do that, also shout out because someone from Microsoft did suggest this to me like 2 years ago. So shout out. I do remember Nishani, you, you said I should do that. And I'm like, yeah, we should. All right, so if you think we should do that, just say hotline, right? Do a comment in the livestream or leave a comment on the Spotify. Just say hotline if you think that'd be fun. Maybe it will. All right, then it also said micro membership prompt vault. All right, so this is good. I would say these are much more impressive. Yes, this one requires judgment on my part. It is gray area, but looking at what Claude 3.7 Sonnet and GPT-4o gave me, Gemma 4, much, much better. All right, let me do one other that for sure some failed on. All right, so uploading, uploading photos might do that, although I don't have the original photo that I use. Let me see. All right, let's just do one other one here. Okay, we're going to do uploading a transcript. I like that one. So let's go ahead and let me find this file here. All right. So I'm going to go ahead and put this prompt in. It's a little bit longer. And then I'm going to be uploading two different files here. So I want to make sure that I get these, get these correct. All right. There we go. I should go in my downloads folder. That, that would help. All right. So here's what we're going to try, and this will probably be the last one. All right. So I said, for this chat, you will turn a podcast transcript of me, Jordan, the host of Everyday AI, talking about AI news, turn it into a choppy and engaging newsletter copy. I've attached examples of previous newsletters and how they should be written, as well as the most recent podcast transcript. So this is my podcast transcript from yesterday where we did a Start Here series about vibe coding. And then I said, please write a newsletter for the attached transcript mimicking the style as closely as possible to the example given. So we'll see here we're getting a little dot, dot, dot. So if I'm being honest, I don't know the last time that I uploaded two different file formats. So I uploaded a PDF and an RTF file here inside Ollama. So again, this one is not the fairest comparison because again, technically here we're also relying on the technically the harness of Ollama and not just the model of Gemma 4, whereas before, you know, when we were testing this against GPT-4o and Claude 3.7, we were using it. Okay, so I do know, okay, it is working, right? I'm like, okay, this should be able to, right? Ollama is amazing. It should be able to handle, you know, multiple kind of file types. So we are, this one is taking the longest so far. This one is the first time that we're probably going to have it be able to think or reason for more than a minute or two. And again, y'all think about this, just the fact that you can have a local model that now reasons without paying a cent is crazy. All right. So it also gave me a checklist of adherence, which is great because I didn't even ask it to do that. But that is something that if I was rewriting this prompt that I've been using this for like 2 years, I would have rewrote this. So it went through, it created a checklist based on what it found from the examples that I, that I uploaded. So as an example, right, I gave yesterday's transcript and then I gave a 30-page document of older newsletters. So it went through, it examined those. It actually only took 27 seconds. It kind of picked out the tone style, the format, the context source, all these things, hook, intro, quality. Let's see. All right. It actually did a pretty good job because I remember this was my intro of the podcast. All right, so I'll read it. Let's be real. You can tell it— and if you read our newsletter, let me know if this sounds like it might be in our newsletter. All right, let's be real. You can tell an AI your wildest dream home and poof, a building appears in front of your eyes in minutes. It's exactly what you asked for. You move in. It's awesome. But then you want to hang a towel rack. You run into a wall and you realize the entire thing is held together with duct tapes, hopes, and dreams. There wasn't a permit and the foundation is shaky. You're in trouble. All right. This actually did almost too closely to my actual intro from yesterday. But as I'm looking for this, as I'm looking at this, it actually did a pretty decent job of writing something in my tone, kind of this short, choppy style like I told it to, you know, an emoji in each headline, which is what we would normally do. It has an actionable try this section. Which is something that we also do in the newsletter. So although this is not, you know, the best ever, right, it actually did a pretty good job. From what I recall, it did a little bit better job at instruction following than Claude 3.7 Sonnet. I do think Claude 3.7 Sonnet did a little bit with the tone of voice, but it did a better job tone of voice or matching the tone of voice than it did than GPT-4.0 did. So Overall, when I look at the, you know, 6 or 7 kind of different unofficial rubric tests that we did here with a free local model comparing it to the frontier general use case models from 15 years ago, or sorry, 15 months ago, the best in the world, it actually did better because even though it failed, right? And I wish it would have gotten it right. Like the 2 that it failed previously, it actually got those right the first time I ran it. Which didn't happen with 3.7 Sonnet or GPT-4.0. But still, head to head in this very unofficial rubric, it did markedly better than the best models in the world from a year and 3 months ago. All right. So as we wrap this one up, here's what I want to leave you with. Open source AI is getting smaller, faster, and harder to ignore. All right. Google built Gemma 4 specifically for agent workflows with native function calling. All right. So even though I didn't give an example of, you know, running this agentically. You now— I cannot tell you how important that is. If you have a middle-of-the-road new, you know, MacBook Pro as an example, you can now have an agent that works for you 24/7 that costs $0.00. It's 100% private. Also, that's worth noting. This is based off of the Gemini 3 model family. So you're not getting quite the Gemini 3 level, But again, you are getting a top 3 open source model in the world and the only one that you can run on consumer hardware. So now users can route routine AI tasks locally and cut significant costs on AI bills. And the gap between the free local models and paid cloud services keeps shrinking fast and you can no longer ignore it. All right, if this was helpful, tell someone about it. Uh, you know, if you're listening, uh, live here on LinkedIn, take a second to repost this. I'd really appreciate that. If you are listening on the podcast, do me a favor, take 30 seconds, make sure that you're following or subscribed to the show. But then if you could, if any episode of Everyday AI has been helpful, right? Because we spend literally countless hours helping you all understand how this works. So if this has been helpful, please leave us a rating on those platforms as well. So thank you for tuning in. Make sure to go to youreverydayai.com, sign up for the free daily newsletter. We're going to be recapping today's show and a whole lot more. So thanks for tuning in. Hope to see you back tomorrow and every day for more Everyday AI. Thanks, y'all.

And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going. For a little more AI magic, visit youreverydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.