EP 352: 5 Things to Know About Meta's Llama 3.1

This is the Everyday AI show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business and everyday Life.

The new 405B model from Llama and their Llama 3.1 updates are extremely powerful. I mean, it's open source, free to download, and I think it'll change the business landscape. But there's a lot of things that I don't think people are paying attention to and it's probably not what you think. So today we're going to be going over that and I'm going to tell you exactly what this llama 405B&3.1 what these things are. I'm going to show you a little bit of the new model live and go over five things that you need to know. All right, what's going on, y'? All? Let's get this thing started. My name is Jordan Wilson and welcome to Everyday AI. This thing is for you. Well, it's for all of us. It's a place where you know non technical people, but still people who want to be technical can learn about all things generative AI to grow your company and to grow your career. So if that's you, thank you for tuning in on the podcast. Always make sure to check out your show notes. We just launched a cool campaign I'm going to tell you about here in a second, but always more information and make sure if you haven't already, go to your everyday AI.com and sign up for the free daily newsletter. All right, so let's get into it and talk about Meta, Llama 405B, the new model and Llama 3.1. So we're going to give you what you need to know, what people aren't talking about, and we're going to show you a little bit live. All right. And hey, for our live stream audience, thank you as always for, for joining Michael and Brian and Fred, a couple Chicago people in the house. Denny, Cecilia, thank you all for joining us. So let me know, have you all used this new llama 3.1 yet? Are you going to. What questions do you have? Please get them in now. I'll try to tackle them at the end, but let's just get straight into an overview here, y'. All. So here's what's new. So you have technically three different tiers of models from Meta, right, the parent company of Facebook. So Mark Zuckerberg did all his media rounds yesterday, wrote a very long, you know, blog post about the future of Llama and open source AI. But here's essentially what you need to know. In april, Meta announced Llama 3, right. And they essentially had. They said that there's three different sizes, right? A small, medium and large. And that seems to be the new trend, I think started by Anthropic. Right. And essentially there's use cases for small, medium and large. And we'll talk about that a little bit more here. But back in April, when Meta first announced Llama 3, which is a huge upgrade, they only came out with the kind of small and medium models. So when we talk about what is 405B and what is 8B and 70B, well, those are sizes of models. So the big one, the 405B has had not been announced until yesterday or is not available. Whereas the other smaller, the small and the medium sized models were available, but they've been upgraded. All right, so I'm going to go ahead and share my screen a little bit here and we're going to walk through some of the benchmarks because they are impressive. All right, so let's go ahead and share my screen here. So for, for our podcast audience, I'm gonna try to do my best. I don't think you're, you're gonna be missing out on anything here because I think I should be able to kind of walk us through this just a little bit. So like I talked about here in live stream audience, let me know if you can, if you can see this. But so multiple new models from Meta. So like I talked about, we have a. Think of it as a small, medium and large. Just like Anthropic we have. Right. So Anthropic has their haiku small, their sonnet, their medium and their opus large. So for Meta, they're actually just naming it by the number of parameters it's trained on. So they have their 8B, which is their small, their 70B, which is their medium, and then they're just now released 405B, big jump up. Right. And without getting too technical. Right. Because our audience here is for the most part not super technical people like myself. Right. The easiest way to think about parameters is the amount of data that it's trained on. All right, so let's go and just jump into the benchmarks because that is kind of our first point that we wanted to talk about is these benchmarks are pretty impressive. And again, I have to really hit rewind even, because we have to draw a line. Because even if we're looking here at these benchmarks and this is what everyone always talks about and rightfully so, right? So benchmarks are when all the smart researchers and scientists from both Meta and everyone from all the big companies, third parties, they all do these benchmarks and you essentially get a score, right? So think of like you know, a new car, right? When a new car comes out, you know, you get, oh, the EPA estimated gas mileage and you know, goes through all these, you know, third party, you know, safety tests, all these things and it gets scores, right? So large language models are the same way and there's all of these different, dozens of different benchmarks. But the one that we talk about a lot here on Everyday AI is the mmlu. Okay, so the MMLU benchmark is the massive multitask language understanding. So it's essentially 57 different subjects and you get a score, right? So it's like the ACT or the SAT for large language models. And this is by far the gold standard. So when we talk about MMLU and this new llama 3.1, the large variety. So that's what we're going to be sharing here in the screenshots. It is very impressive. And I have a, I have a screen here earlier that I'm going to be showing. But we have to keep in mind this is an open source model, y'. All. So what that means this is free, this is free to use. You can download these models, although you really have to have like the world's strongest computer to download the 405B. But for the small and medium models, most of us out there, if you have a new ish computer with a, a decent, you know, graphics processing chip, if it has decent specs, you're going to be able to download these, these, these models from, from Meta. So that's like, before we get into these benchmarks anymore, we really have to talk about the importance, the importance of this is open source, right? You can download it, you can build on top of it without having to pay, right? Those inference costs, those training costs over and over, which is huge. Okay, and this is also, it's available in a lot of dev environments, which I'm going to show you here on the screen soon. So with that, let's look at these benchmarks. So the MMLU Llama came in at an 88.6, which is extremely, extremely impressive. All right, I might do a full show soon. Live, live stream, audience, let me know. Do you want to see that? I might do a full show soon on mmlu. What are these benchmarks? What do they mean? But essentially, if you are an expert in one specific Thing. So again, these models are trained or, sorry, the mmlu goes across 57 different subject areas. Think if you are a world expert. In one, a world expert is going to get about an 89.8. All right, an 89.8, a world expert on that one domain specific field. Okay. But in the other 56, the average person gets about a mid-30s. Okay? So think when we say that llama has an 88.6, that means that a free model that you can download now is essentially a world class expert or almost as good. It's like having the 57 smartest people in the world available for free their entire knowledge. And you can build with it, you can download it, you can work with it, you can make it your own. Okay, so that's what we talk about when we're talking about both MMLU and the power of having these high up scores in an open source model that you can download, you can fork, you can build upon and you're not having to, you know, pay a big company each and every time. All right, so benchmarks are extremely important. So the Llama 3.1, it is above quad 35 sonnet, but it is just below GPT4 Omni. So GPT4 Omni 88.7, Llama 88.6. Right one fraction. Right 1.1 fraction of a point away. Which I was surprised about. I was surprised that Mata didn't sit on this for another couple of weeks and try to over engineer and try to squeeze a little bit more juice out of it. So it's the world leader on mmlu. But regardless, a free open source model that is essentially now the most powerful model. Extremely impressive. So yes, the human eval scores also very, very top notch. An 89 when the, the leader Claude is a 92. Pretty good there a couple though that are worth noting about. I'm not going to talk about benchmarks this entire time, but two other things. I mean GSM8K, which is essentially, you know, math. Right, basic math. And 96.8, the most capable model right now in the world. Also the ARC challenge, which is reasoning, got the highest scores of any model. So when we talk about benchmarks, extremely impressive. Okay. We also have to talk about availability, where this is available at. Right. So we talked about you can download this now. You can also go to Meta AI. I'm not sure which countries have access. I didn't get a full list from Meta. I'm sure they'll be rolling out with that soon. But you can go to Meta AI. You do have to log in with either Facebook account and Instagram account, but you can use it for free, literally right now. And I'm going to be going over a little bit of that live. But we have to also talk about where this is available, right? Because if you are a business leader and you are looking, let's say you're working at a Fortune 500 and Inc. 5000 company, a big enterprise, right? This is available now, showing on the screen here. This is available now in so many places, so many places here. So AWS data bricks, Nvidia's Foundry, IBM, Google Cloud, Microsoft scale, Snowflake, right? So, so where so many of these big companies, big enterprises house their data, where they're trying to marry their data with the right large language model. It's available now, it's available today, which I think I love that from Meta, right? You can have whatever thoughts you want about Mark Zuckerberg, you can have whatever thoughts you want about the social media side of Meta. You know, Facebook and Instagram and WhatsApp and data collection, all of these things. You can have whatever thoughts. But the fact that Meta announce this, drop this, and it's available all instantly, hats off, right? Because Google is notoriously bad for, you know, having all these big conferences, right? At their Google I O conference, they announced all these things, this is months ago, and we haven't seen a fraction of them, at least when it comes to their new large language model developments and generative AI Meta, it's like drop a blog post, drop some interviews, and it's live, it's ready. So you can probably today go and work with this in your environment right now. And again, it's open source, y'. All. All right, so like I said, the first, the first thing that you need to know is the specs are extremely impressive. So like I talked about that, the benchmarks are great. A couple other things. The 8B and the 70B versions, the small and the medium, those are upgraded. So that is the big jump from, you know, llama 3 to llama 3.1. So even if you look at just the improvements in the small and the medium model here, they're. They're huge. They're. I mean, they're very impressive. So the small in the medium models, if you look at them in their respective quote unquote weight classes, right? Especially the 8B, because I think the 8B probably within, I don't know, six months to a year of hardware, I think you're going to be able to see this as an edge device, as a model that could in theory run locally on a phone. So that's the other huge upside to being open source and to be able to download a model is you can run it locally without Internet. So then privacy concerns are less. Are you still running in circles trying to figure out how to actually grow your business with AI? Maybe your company has been tinkering with large language models for a year or more, but can't really get traction to find ROI on Gen AI. Hey, this is Jordan Wilson, host of this very podcast. Companies like Adobe, Microsoft and Nvidia have partnered with us because they trust our expertise in educating the masses around generative AI to get ahead. And some of the most innovative companies in the country hire us to help with their AI strategy and to train hundreds of their employees on how to use Gen AI. So whether you're looking for ChatGPT training for thousands or just need help building your front end AI strategy, you can partner with us too. Just like some of the biggest companies in the world do. Go to your everydayai.com partner to get in contact with our team or you can just click on the partner section of our website will help you stop running in those AI circles and help get your team ahead and build a straight path to roi. On gen. Speed is more environmental concerns are less of a concern at that point when you can run a model locally and you don't have to, you know, run it off of essentially a server and so it's faster, the latency's lower, it's more secure and you don't even need the Internet. Right. But the 8B model especially, I'm looking at this and this is what I don't think people are talking about. So if you compare it to Google's new Gemma 2 model. So these are again, I would call these something between a small language model and a small, large language model. There's no actual definition because the goal posts are always moving. Right. But these are models in theory, llama 318b 8 billion parameters and gemma 2.9b. These are models that in theory can be running locally on a smartphone probably within six months to a year. Right. So right now Google also has Gemini Nano, which is one of the ones that's running on current smartphones. But you have to also think when you see all of these announcements, we can't just look at the benchmarks and what they mean today, we have to look at what do they mean in the future. So I already told you, this has huge future implications which we're going to get into about how businesses can Run now. But you also have to think of what this means for the future of on the go AI, which is the future. I've said hundreds of times the future of large language models is small language models and working with many of them and working with them on edge AI, on device AI. But the 8B model just is out punching its weight class in almost every single benchmark aside from like one. It is the top model, it is the top small, large language model and it's not even particularly close. And again, open source. So think of what this means for the future of even apps that you use, right? Because now all of these developers, you know, it's not like even with GPT4O mini, which we're going to talk about here, that brought the cost way down. But you know, a month or two ago, you know, could be expensive to go launch a brand new app that was powered by AI for, you know, enterprise business or just something that's, you know, fun for people to use. This changes things. This changes what people with low budgets can go and build in a, in a weekend or in a day and launch immediately. This brings scalability to even small companies that don't maybe have, you know, compute power. Well, you, you might not even need it with an 8 billion parameter model, which is fairly small. You can download this and run it on a machine that's not even very powerful. All right. And the benchmarks are extremely impressive there. Also another thing to note, and I promise you this is it for our, for our more technical side. All right, so 128k context window, huge, right? Because the context window was very small before. I believe it was 8k or less. Also Meta is using a slightly different and this gets into a little bit of the technical side, but mixture of experts or MOE is what a lot of these large language model companies have been using. So Meta will put it in our, in our newsletter today. They want a different route going. This herd of experts versus the mixture of experts. All right, so enough on the technical side. Let's go ahead and talk about the second thing that you need to know. And I think that this is shots fired. I mean shots fired against OpenAI. But this is a developer focused strategy, right? Because I think people are overlooking the vast improvements that were made in the 8B and the 70B, the small and the medium models. And what this means is I think they're just going after OpenAI, right? We saw Anthropic with Claude 35 Sonnet. We saw Gemini, Google Gemini with 1.5 Flash. Right? So and Claude presumably will be releasing 3.5haiku, which is their small model. Right. So Haiku sonnet opus so over, I'd say in the first quarter or two of 2024, OpenAI had lost traction, I think, among developers. They were jumping ship. We had a whole episode about this on Friday. But you know, right after they released their new model, GPT4O Mini, which is essentially a light version of their big Boy model, right? So now OpenAI has essentially a small and a large. They don't have a medium per se. All right. But this really changed the developer landscape. So OpenAI, I think, was losing customers. They were going to Google Gemini for 1.5 flash. It was cheaper and more powerful. They were going to anthropic for Claude 3 haiku, it was cheaper and more powerful. You know, OpenAI was essentially relying on either 3.5, which wasn't very powerful, or GPT4, which was very expensive. So I do think that OpenAI did make a huge splash with GPT4. Oh, mini. Did that happen to coincide with the fact that Meta decided days after to release their 3.1 updates? Potentially. Right. Because I think they are now going directly after developers. And it can also be lost on us how OpenAI responded. I talked about that at the top of the news this morning. Literally hours after Meta released a very impressive 3.13 models, benchmarks go wild, right? Literally hours after that, Open AI said, oh, you know what, we're actually gonna make cost zero for the next couple of months to come and fine tune your models, right? So hey, hey developers, hey businesses, right? Hey businesses, you want to, you want know, bring in rag, you want to have this retrieval augmented generation, you want to kind of marry and create your own large language model with your data and some fine tuning. Generally, you know, a year and a half ago, very expensive, very hard to do. Now it's easier and it's cheap. So OpenAI said, hey, for the next couple of months, you can come in and do it for free. Two million, two million tokens a day, which I think is indirect response. They saw what Meta dropped and they're like, whoa, these benchmarks, pretty dang good. Pretty dang good, right? We don't have comparisons yet with the 8B 70B and GPT4O mini, but I'm sure those will be rolling out here soon and we'll talk about it. But this is a developer focused strategy from Meta and it is a direct shot to, to Open AI. All right, So I do think, at least right now, it's a Two player battle. It's a two player battle. But what this does mean is I fully expect Google and Anthropic to be releasing updates in the next two months. Right. This changes it. It's getting so, so cheap where it's, it's getting to the point to train a model, you're not going to have a lot of costs. Right. We always talk about inference and, and the cost per token of training. When we see a meta like a model like llama 3.1 and they're 8B their 70B, it's 399, y'. All. Yeah, you got to have a computer powerful enough to, to handle it. You still need the skill set. But the cost to train a model on your company's own data, the cost to build something on top of a large language model is going down to like 399. Right. Whereas a year and a half ago, pretty expensive. And now the availability is everywhere. You saw the chart, right? It's Nvidia, it's, it's available inside Nvidia, it's platform, their, their foundry platform. It's available inside of Microsoft, inside of Google, inside of Databricks, inside of Snowflake. Right. So all these dev environments, it's available there. So the cost is going down and this means that I think Google and Anthropic are going to be responding here soon. All right, number three, the thing that you need to know is it is ready to be built upon. Right? So we did kind of talk about that. You don't have to wait. You don't have to wait. It's literally available now and it's available in all of those platforms. I didn't even talk about AWS, but yeah, AWS's platform, Dell, Nvidia, Gro Gro with a Q. Not the large language model from Twitter that no one uses. IBM, Google Cloud, Microsoft scale, Snowflake, it is ready now. Right. Which I, again, I talked about this at the top of the show. I love meta's approach here. Don't, don't make us wait. Right. Google is, is like, hey, we're, here's some marketing, here's some promise. Let's see how our stock goes up or down and maybe we'll release these in the next six months to two years. Open AI kind of in the middle, open AI. You know, when they had their spring event, they dropped their model that day. But a lot of the more powerful features we're still waiting on, you know, we should be getting them in theory any day. But Meta, Meta just Literally, you know, Mark Zuckerberg, new hairstyle, looking, looking fresh with the gold chain. Just drop, mic, drop, here's everything, go out and play. Available everywhere now, right? Changes how business is done. All right, so number four, the number four thing you need to know. An open source llama 31 is more than your average large language model. Okay, Again, we'll be linking to this in our newsletter so you can read a little bit more from both Zuckerberg's long blog post on the future of open source and what that means. But it means a lot of things. So he talked a lot about model distillation, distillation. So that essentially means the big model, the 405B can act as a teacher to quote, unquote, train student models, right? You can also companies can make models of any size. That's the other thing. If you are working with a closed source proprietary model, which is what all the other big guys are, right? So Google, Gemini, Anthropic, Claude, Chat, GPT, etc, those are all closed source, proprietary, right? It's, it's, it's not a bespoke option. You know, it's one size fits all or you don't use it. So you might be overpaying or you might be underutilizing. But with this model distillation with Meta 3.1, you can make models of any size, right? You can use the big model to train the smaller models. Also a huge thing here is the synthetic data generation. So llama 3.1 can generate high quality synthetic data to enhance the performance of smaller models, right? We always talk about where is this data coming from? Where's this future high quality data coming from, which I personally think is a huge problem, right? Because models for the most part are trained on the open Internet. And guess what? People don't know this, but this predates Chat GPT's release. People, you know, SEOs, content writers, they've been using the GPT technology since 2020. So I think you have this almost this data regurgitation issue where so much of the data right now is being built by AI, right? A lot of studies say by 2026, more than 90% of new content on the Internet will be created with AI. So you have this problem, where do you get this new, this new data, this original data? So what META is kind of doing here with this synthetic data generation is you use the big model to create, quote, unquote, new model or sorry, new data to train the smaller models or to train your company's models. Another thing is the customization all right, and this is why it is much more than your average large language model. It allows for model architecture customization based on specific task or hardware constraints. So what that means is if you do want to build, let's just say a customer, customer service large language model for your company, right? Put in all your data. If you're using a GPT4O mini, if you're using a Claude 3, if you're using a Google Gemini, you in theory are going to still be using the full model, right? So you can essentially, with an open source downloadable model that you can fork, you can build upon, you can essentially do anything you want. Think of it like this. It's a template inside of a word doc. It's a template inside of PowerPoint. You can move things around. You can, you know, if it's 100 pages, you can delete it down to just the 10 pages you need. You can't do that with the other models, right? Think of them as like a PDF. You can't go in and update them. So a lot of times you're either overpaying for what your business may need or you're sacrificing speed. Right? Because you still got to use the full model, even if you only need a little sliver. Okay, and, and also, I mean we have to talk about our last thing that we need to know. Well, actually let's look at a, a graph here first. This is changing. All right. The, the gap between proprietary closed source models and open source or open weight models is diminishing. So shout out to the, the original creator of, of this kind of graph that I'm showing here, maximilaboni I, I believe on Twitter there. So about two years ago, night and day difference. All right, so we have essentially MMLU on the left side and then we have our dates on the other access and we see that there was such a huge disconnect about two years ago, even about a year and a half ago between these open source models, right, that are free and available and anyone can fork them and do whatever they want. And the closed source models, as of yesterday, there really is no difference anymore. It used to be night and day. It used to be that open source wasn't really a good option for your business because you were sacrificing on output quality. You were sacrificing on mmlu. You were saying, hey, we could use this free open source model, but it's kind of dumb. Not anymore. The gap is essentially non existent. It is 0.1, it is 0.1 difference. On the MMLU, right? Whereas before it was 10 points, 20 points, 30 points, now it's essentially a wash on, is the model smart enough? Is it capable? As capable as the others, right? When we talk about the difference between the world leading model, GPT4 Omni 88.7 in the now free 405B from llama88.6, it's no longer night and day, right? It's no longer night and day. We're essentially talking about and looking at the exact same thing. All right, let's go here. So number five, the last thing you need to know is obviously this new model has tremendous business impacts. All right? I'd say the last 72 hours between OpenAI's GPT4O mini with Meta's 3.1 release, the 405B release, and also now with OpenAI saying, hey, come play for free until September, this completely changes what's, what's possible with your business, right? And I'm talking a little slow here because I'm, I'm thinking, and I hope that you're thinking about this too. And I want to point something out that Mark Zuckerberg said yesterday in an interview. And I said this, y', all, I kid you not, there's always receipts. I said this back in December and I think people laughed at me and thought I was crazy. But back in December, my prediction was by 2024, we'll see. But I said there will be more AI agents than humans, right? And funny enough, Mark Zuckerberg said the exact same thing yesterday. I hadn't heard any, you know, big person in tech say anything like that. And yesterday I'm like, yeah, exactly, I said that in December. And you know, now Mark Zuckerberg, who you could argue is one of the most prominent people in the world in AI right now, right? At least a handful, you know, of five of the most prominent people in the future of AI, the future of artificial general intelligence, AGI, in theory, the future of asi, right? Mark Zuckerberg is one of the most important and prominent people in the world right now because AI and generative AI and large language models impact business. All right? And you'll see, MATA has essentially thrown, not thrown away, but they've set aside their whole Metaverse thing, right? Three years ago is Metaverse, Metaverse, Metaverse. And now it's like spending, you know, hundreds of millions of dollars on compute, right? They spent, I believe, $700 million just on GPUs to train Meta 3.1 and their future META models. But, you know, the future Business impacts. Mark Zuckerberg predicted there will be more AI agents than humans. He said every single business is going to have multiple agents, Right? And he's not just saying on their platform, he's talking about the bigger picture. And he does think and hope that the Llama model is going to be the most used AI model in the world. And you have to think it kind of might be possible, right? It might be feasible, because guess what, their model is everywhere. Yes, you can go to Meta AI, which we're going to show you very briefly here in a second, but it's also available in Instagram, it's available in Facebook, it's available in WhatsApp. So Meta has the reach. And guess what? Yes. When you use these models, you're making them smarter. So you know, people are always like, oh, it's free, right? Oh, have another episode at some point the downsides of using AI. And if you're using something for free, you potentially, yeah, you, you are paying for it by giving them your data, giving them your feedback, etc, But Meta does have the chance with their model to be the most used AI model in the world. And it's pretty feasible. And so you have to pay attention when Mark Zuckerberg talks about how AI, AI, agents, large language model are going to completely reshape what, not only what is possible, but how business works. And I've been saying this since day one, the future of business, especially here in the U.S. we are all going to be working with agents, large language models, small language models, we're going to be prompting, that's what our future work is going to be dependent on. You are not going to be in, I don't know if it's going to be 2 years, 5 years, 10 years. You're not going to be rewarded and promoted. Your company isn't going to grow by the experts, by the subject matter experts anymore, by the knowledge, by what you know, because all of that is being transferred into large language models and in the future, small language models, right? When you have these very capable models or agents that are going to be trained and fine tuned on one very specific task, right? Think of that one specific thing that you do, right? And then let's say you're lucky enough to be, you know, in the top 1% of people, let's say in that one very specific thing that you do, you're you and 100, you know, you and 99 other people are the smartest in the world at that one very specific task, guess what? Very soon, a small, a small language model, because of what's happened in the last 72 hours, there's going to be a fine tuned model that does that one specific task much better than you and the other 99 smartest people in the world combined. So the future of how we work is getting the most out of these agents, knowing how, when, and ultimately why we should be using them, and how we can squeeze the most business value out of agents, out of generative AI, out of large language models. That's the future of business. And that's why I think Madalama has tremendous business impact. Because over the past 72 hours, the future of how we can work in the timeline, the timeline has shortened exponentially because even a couple of months ago you'd say, ah, you know, this, this, this is going to take a while. Not anymore. This is like, you know, this is the equivalent of, you know, I don't know, 20 years ago, it used to be hard to get your company on the Internet, right? You had to hire someone smart. You had to put a lot of work in, right? So imagine 20 years ago, someone just drops, hey, here's the best website in the world. We're going to do it all for free, right? Imagine the gold rush to a dot com, right? It wouldn't have taken 10, 15, 20 years for companies to really thrive online. This is a legit generative AI, large language model gold rush. The big players are putting things down and saying, it is now free or free 99, it is cheap and the possibilities are endless. All right, so those are the five things you need to know. So now let's just take a quick look live. All right, so for our live stream audience. And hey, I'm going to be getting. If you do have questions, like Monica said, did you do a demo for this? Got one right here. Got one right here. But if you do have any other questions, go ahead and get them in. I'll try to answer them here at the end. A course would be good. Should I do a meta course? Gordon saying I should do a meta course? Maybe, maybe. Let me know if you think that would be helpful. All right, so, all right, let's go. We're just going to do some very basic things. All right. I did a whole video yesterday running through this, but let's just do some common things here. So I am going to meta AI. Okay, so if you, you do have to log in, you do have to log in to your either Facebook or your Instagram account. All right, so a couple things you need to know. And I'm glad They did this. There's even, there's even been updates since yesterday. I really railed against Meta for a couple of things and strangely enough, they fixed them. Some of those things have been fixed. A couple. There was some confusion in the model selection. So now you want to go click your profile and go to Settings again. There's other ways you can access this. You can access this also on a hugging face. You can download the models, run them locally. I'm just showing you probably the easiest way to use this, which is just going to meta AI. All right, this is not the front end interface that maybe you're used to. It doesn't have the features and functionalities of a chat GPT, of a Claude, even of a Google Gemini. But if you just want to see if the model is right for you, for your business, it's a great way to do it. All right, so you can go click on settings and then you can go to change your model. Okay, so I already changed it to the big one which is 405B. So you can either use the 70B. So again these are the 3.1 updates. So, so the small and the medium were updated to 3.1. So yesterday it still said 3 and I'm like meta, what's going on here? But you can either use the 70B or the 405B. So you can't use the small one. I'm wondering if they're going to change that pretty soon. But. So right now I'm going to select meta, I'm going to select llama 31405B. All right, so a couple things on the interface, it's super easy to use, super simple, right? So you have your chat history on the left hand side and at any time you can collect, click new conversation. But all you can really do, there's. There's two things, right? There's text, so you can do text to text or you can do text to photo. I'm not going to be going over that. But they have this Imagine feature. It is pretty cool because you can type something in real time. So I can say Chicago and it's going to start. I don't know why it brought up a random dude. So I can type in Chicago Skyline and it actually should be doing things like live, I can type in Chicago skyline, Hot dog, right? So then there's a hot dog. So you know, it does these live. I'm not going to go over this too much here. The Imagine feature, the, the text to image, but the rest of this you can Click new conversation and then just chat with Meta AI like you would any other large language model. All right, so I'm going to run a prompt that I run sometime. And again, I did this yesterday. So I'm saying this is a logic. A logic prompt, essentially. So I said, I just woke up today with six apples and three bananas. Yesterday I ate a banana and two apples. This morning, I will eat one apple and no bananas. However, I don't really like apples, and one banana may turn brown tomorrow. Assuming nothing else changes, how many apples and bananas will I have tonight? I'm going to create an actual, like, quote, unquote testing series of questions that I can do with all these models, but this is one I generally use. So if there's a new model, you know, sonnet, 35 GPT, 4o, mini, etc. I usually have a set of five to 10 prompts. These aren't scientific, but these are either logic, reasoning, math, creativity. I have a couple prompts that I run. A lot of models get this wrong. So what I like by default, right? So again, I'm using the 405B by default, which I like here. Meta takes essentially a chain of thought, prompting response, even though I didn't tell it to. You gotta love that. The first thing it says is let's break this down step by step. Which is a great prompting technique, right? It's, it's. It's kind of the, the essence of, of what we do in our free prime prompt polish course, right? So it's saying, let's break it down step by step. So I'm going to go down to the bottom, see the answer. It says, tonight you will have five ample, five apples and three bananas, which is correct. So a lot of models get confused. I put in a lot of nonsense to try to throw the model off. It does a good job here. All right, let's go ahead. I'm going to do another prompt. This one. So many models get wrong yesterday. Mata got it kind of right, kind of wrong. So I'm going to run it the same. Also, what's important to know, I say this a lot. Generative AI. It's kind of like rolling the dice, right? Which is why prompt engineering and understanding how models work is so important. You can run the same prompt 100 times, get 99 different results. You could get three different results, right? It is generative. All right, so let's go ahead and try this prompt here. I'm saying a man and his dog are standing on one side of the river. There's A boat with enough room for one human and one animal. How can the man get across with his dog in the fewest number of trips? All right, so it says a classic puzzle, right? Which I, I do think there's all of these kind of like brain teasers or kind of large language model logic tests that a lot of people have been doing. And I do think by now a lot of large language models, because they're trained on the open Internet, are scraping all of these, right? So people post these to, to Quora, to, to Reddit, blog posts, etc, and so models, I think over time understand the answer because they gobble up all this information on the open Internet and then they learn from it. So let's see if this gets it right. But most models get this wrong, you know, so let's see how it does. All right, so this, this get it got it wrong. So it said, it essentially said three trips, right? The correct answer is one trip. If a man and his dog are on one side of the river and they have a boat with enough room for one human and one animal, it just takes them one trip to get across the other side of the river. This one says it takes three. Yesterday it said, technically it said two or one round trip. So it got it kind of right yesterday. Today didn't get it right. It got it actually fairly wrong. All right, let's try one more Again, this isn't supposed to be a full live breakdown of Meta, but I wanted to at least show you some of the capabilities of what it, what it's, what it's possible. So this is something that I think most businesses could relate to. So I'm saying, oh, maybe not. You're maybe not creating a new company, but using this to brainstorm, to ideate, to strategize. That's what large language models are great at, essentially. Being a companion to help you build a business. Being a companion to help you market your department's campaign. Being a companion to help you essentially poke holes in things, right? So I'm saying here, create a, a new company and brand for a future smart home device. This will solve a problem that does not currently exist. To start, come up with the company's name and its first flagship product. Give the product a name, branding campaign. Go to market strategy, tagline and rationale for why it will work. Respond in a succinct way, keeping responses to short bullet points, short bullet points, but with ultra specific facts. All right, Hey, I might want this one. So here's what Meta said in its 405B 3.1 inside of Meta AI the company name is Echoplex. The flagship product is Dreamweaver. It solves the problem of sleep data overload. I could use that. I'm not gonna read the whole thing but you know the product, it has the product description in there. Looks good. The branding campaign, the tagline is unlock the hidden narrative of your mind. Not bad. I've seen worse. It even has a color scheme with hex color codes. It gives examples for a logo. This is a zero shot prompt, y'. All. A very poorly written. There's no prompt engineering and the results are pretty good. That's one thing I've noticed with this new model you don't have to do as much prompt engineering to get something decent. Right. A lot of times short prompts and other models don't get you great things. It does always almost seem like meta over delivers when your prompt under delivers which, which I like. So it does even have this kind of almost seemingly built in chain of thought reasoning and it always seems to give you a little bit of more without just being verbose. Right. So a lot of large language models, what they do is if, if there's ambiguity because your prompt kind of stinks, it's just going to spit a bunch of general nonsense content that you don't. It's not really good. Meta doesn't really do that. I think they give you specific content that is actually good. So we also have the go to market strategy. It's. It gives us a target audience, launch channels, it gives pricing, how much this device should be priced at. It has the rationale which is pretty, pretty spot on. Right. It says there's a growing interest in brain computer interfaces and neural implants. That's true. A lot of startup money is going into that increasing awareness of mental wellness. True. There's a unique value proposition. True. It's even getting key partnerships. So all right, that's. That's enough for a live model. But again, actually two other things with the interface, I, I did mention that there's some new things that weren't there yesterday which I think are important to talk about and I actually wish that more companies would have this. So at any point you can tell the model if it's a good or bad result. So there's a little interface you can hover over. You can copy content to the clipboard. So here's the two new things which I like. You can share. Okay. So I can then share this chat. I can copy the link and whoever I send this to as long as they have an account can go in, they can see the kind of the transcript and then they can pick it up. So they can essentially fork the chat. It's not going to be shared. Right. But I can essentially give them access to everything I have created up until that point. It's like creating a copy of a document and then that person can have all of that knowledge, have all that work, have the context window, which is also important, and then continue to work with it. Right. So that's a brand new feature that wasn't there a couple hours ago. And then also the ability to save or unsave. Right. And that's especially important. I wish Chat, GBT and Claude had this FE feature because now on the sidebar, inside Meta, I can just click saved and then it's just going to have my saved chats. All right, so that's enough of a quick overview. Let's wrap this thing up and get to your questions. All right, so a couple of questions here, Denny, asking, should we expect to see ad retargeting based on what we put into Llama? Same as can happen based on interactions on Facebook. You know what? I'm not actually sure. There was a lot of information that came out yesterday. I did a video review. I spent hours planning for this show. I haven't read through the whole policy. So we'll, we'll look at that. Denny, I'm not sure the MMLU score, yes, it is ranking correct answers, right? So think of it just like a standardized test. When we talk about mmlu, it's essentially a standardized test, right? There's right answers and there's wrong answers and there's different prompting techniques. Right. So there's some MMLU scores which are based on zero shot, which is essentially copy and paste prompt with no input output pairings that tell a model what's good and bad. But then there's also, you know, like five shot, you know, MMLU scores, which means you can do a little bit of prompt engineering and, you know, kind of help the model get to the correct score or sorry, to the correct answer. But for the most part, in MMLU and a lot of the benchmarks, there's right and there's wrong answers and there's different prompting techniques or methodologies that you use. And then it's like, hey, did you get it right or wrong? Just like a standardized test. Yogesh. Yogesh in the house. Former former guest on everyday AI. What's going on, Yogesh? So saying, will Llama 3.1 make custom GPTs obsolete on chat GBT? It's a great question, right? Because when we think of. I said that this is a huge play for the developer community. So there's something about chat GPT and even creating GPTs. The user experience is so nice, it's so easy. So in its current state, will this very new powerful three. One make custom GPTs obsolete? I'd say no. Number one, because OpenAI still has the most powerful model in the world, even though it's not by a lot. But number two, the experience, the user experience is much easier, right? The fact that anyone can go into chat GBT right now, create a custom GPT with no coding skills, you know, it's not like it's low code. You can create a Jeep, a literal custom version of chat gbt, drag and drop, no code, just say, hey, hey, GPT builder, this is what I need. Let me upload my database. And then it just does it. That's amazing. We don't have that quite yet with llama 31. We do have that a little bit with Claude. We don't yet have that with Google Gemini, but we may once, or if Google ever releases their gems, which is their kind of counterparts to. To GPTs. So right now I will say no, it's not going to make custom GPTs obsolete because the user experience, right, it's not quite there. But will, is that going to be an area where meta plays in? Potentially, right? That is where you start talking about agentic capabilities or agent capabilities. Right. When they're trained on very specific tasks. That's essentially what a GPT is. It's something custom GPT that you can train on one very specific task. And you say, hey, big, big model, just focus on this one, one, one very specific skill set. Here's my data. Let me train you and make sure that you can do this task correctly. So I don't think out of the box, it's going to. All right, y', all, I hope this was helpful. Went a little longer than I had hoped, but hey, that's. That's just Everyday AI for you, right? We do this live. It's unedited, unscripted. I hope today's show was helpful. If so, tag someone, right? If you're here listening in the LinkedIn comments on Twitter, YouTube, whatever, share this with someone if you're on the podcast. Thanks for listening, thanks for tuning in, and make sure to tune in tomorrow and every day for more everyday AI. Thanks, y'. All.

And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going for a little more AI magic. Visit youreverydayai.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.