EP 266: Stop making these 7 Large Language Model mistakes. Best practices for ChatGPT, Gemini, Claude and others

This is the Everyday AI show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life.

I've literally trained thousands of people how to use large language models, and I'm seeing the same mistakes over and over again. So today we're going to tackle some of those most common mistakes and what you should be doing instead. So whether you're using Chat GPT or Microsoft Copilot or Google Gemini, or you're just trying to figure out what the heck is a large language model, today's show is definitely for you. So what's going on, y'? All? My name is Jordan Wilson. I'm the host of Everyday AI. We're a daily live stream, podcast and free daily newsletter helping people like you and me grow our business with generative AI, grow our careers. So if that sounds like you, thank you. You're in the right place. Thanks for tuning in. So before we get started, just as a reminder, go to your everydayai.com sign up for that free daily newsletter. We're actually going to be giving away something in today's newsletter, so you got to make sure to go go check that out. All right, so before we get into today's discussion, and I'm extremely excited to talk about these common large language models mistakes because I think that they're pretty easy to fix. But before we get into that, let's start as we do every single day, with the AI news. And there's a lot of AI news today, so we're going to try to keep it short. But this is some pretty big news happening today. So first, Apple is developing new chips for data centers, which could be a breakthrough in AI infrastructure. So according to a new report from the Wall Street Journal, Apple is working on developing chips for AI software and data centers under the project name acdc. Yeah, that's really it, Apple. Chips in Data center is what it stands for. So the tech giant is reportedly collaborating with the Taiwan Semiconductor Manufacturing Company on the design and production of these chips. The timeline for the project has not been clearly established yet, and the development could potentially lead to more efficient, efficient and powerful AI processing in data centers. Apple's upcoming server chip is expected to prioritize AI inference tasks instead of training AI models, which is the domain currently just being dominated by Nvidia. All right, here's. Here's another one good fun one here, y', all, for any OpenAI or chat GPT fans. But OpenAI is moving closer to potentially launching a search engine to compete with Google as it's moved its entire domain. All right, so this is, you know, normally we talk about other people's reporting. This is kind of our own observations and timing around this. But let's talk about chatgpt.com so when you used to type in chatgpt.com it used to forward to chat.OpenAI.com so as of yesterday this just moved over and now everything, even your old chats, you know, that were saved, everything, everything is now moved over to chat GPT.com so well, why does that matter and what does it have to do with Google and search engines and you know, this new reportedly Open AI releasing a search engine this week. Well, they've had a subdomain open now for a couple weeks of search.chat GPT.com so they really can't launch that until they first moved everything over to chat GPT.com so I know this sounds a little geeky, a little technical, but this is again a major step if open AI, if OpenAI is going to ultimately compete with Google, with Bing, with perplexity, you know, and really become a search engine and maybe change the way that we all work, change the way that we all use the Internet. Also, the mysterious model that we talked about two weeks ago on the show called GPT2 chatbots, it looks like it's been re released into the chatbot arena. So we previously covered the GPT2 chatbot mystery model which was pulled after about 48 hours. So now there's actually two new flavors of this mystery model, presumably from OpenAI called I'm a good GPT2 chatbot and I'm also a good GPT2 chatbot. Yeah, that's the actual names and this time OpenAI CEO Sam Altman mentioned the models by name. So our kind of internal research and thoughts around this suggests this is probably a new powerful but very small version of the GPT model that could be used to power future free versions of ChatGPT Search. Hey, we're already starting with hot takes and it's barely Tuesday. All right, last but not least in AI news, Microsoft is developing Mai1. Mai1, yeah, mouthful. A competitor to the state of the art AI models from OpenAI, Google, Anthropic and Meta. So according to a report from the information, Microsoft is investing in training a new in house AI model called Mai1. So it will reportedly have around 500 billion parameters, making it significantly larger than previous models trained by Microsoft which had primarily been research based or niche small language models. So this is Noteworthy as the new model development would likely put them in direct competition with OpenAI, obviously a company they've invested more than $10 billion in and currently hold a 49% ownership stake in. So this move could be seen as Microsoft CEO Sadia Nadella's attempt to prove the company's independence from OpenAI. So they've been kind of called out a little bit by analysts saying right now that Microsoft is too reliant on OpenAI for its future AI developments. So the development is being overseen by Mustafa Solomon, the ex Google the ex Google DeepMind co founder and former CEO and co founder of Inflection A. So Soliman is now the head of Microsoft's new AI division. All right, so pretty, pretty big news here that Microsoft is saying, hey, we're making our own large language model. They've obviously had some successful small models like 5.3, but this is essentially saying like hey, we are not going to be relying on OpenAI and on GPT4 anymore. So we're not sure what that means. For the future of Copilot, you may have the option to choose between as an example, GPT4 and M8AI1. So we'll have to wait and see. All right, so for more of the AI news, make sure to go to your everydayai.com we send it out in the newsletter every day, so it is hot. Take Tuesday. I'm excited to talk about seven common large language models, mistakes that almost everyone's making. I would say. And this is, you know, you guys wanted this. So in, in our newsletter sometimes we put out a, a little poll and say, hey, what do you want to hear on the show tomorrow? And then I spend, you know, a ton of hours researching. I was up again late until midnight and up again at 5am but bringing you guys the latest and greatest. So this is what you wanted to hear. So let's dive into it. But I'm also curious for our live audience joining us live. Thank you all. Like Harvey from joining us from Texas or Brian from Minnesota, Juan from Chicago, Rolando from South Florida, let me know, how did you learn to prompt? I'm curious, right? This wasn't something that's taught in schools, right? It's generally very new unless you just graduated. But you know, a, are you self taught and did you kind of wing it? B, did you read prompting papers? That's what I do. I spent a lot of time on weekend reading scientific research papers on prompting methodologies. Maybe C, you took a prompting course. Maybe it was ppp or did you Just go with the copy and paste prompts. You know, I'm curious, and also for our, Our lives, for our podcast audience, check your show notes. We always put that information in there. But, you know, I'm curious how you all learn to prompt. So let's just get straight into it. You know, someone, someone said in the newsletter that I, I waffle a little bit too much on the podcast. So I love waffles, but I'll try to, I'll try to keep it shorter. All right, so let's start number seven in the seven most common mistakes that people are making with large language models is not understanding. Large language models have a knowledge cutoff. All right, so I've had full episodes on what a knowledge cutoff is and what it means. But essentially, large language models scrape data, right? Whether it's open and publicly available data and information, or maybe it's copyrighted information. Right? But still, essentially, these large language models scrape up the entirety of the Internet, right? Which is sometimes good information, sometimes bad information. And then humans more or less train these models and try to make it more about quality than quantity. But still there is a set date where, you know, models kind of stop, quote, unquote, grabbing, and then they take all this data, and then the humans, you know, spend weeks or many months kind of going back and forth and fine tuning and training the model, right? But this is important to understand because, well, up until recently, sometimes we were working with training data that was more than a year and a half old, right? So now, luckily, you know, most of the, you know, most of the newer models have, you know, knowledge cutoffs that are, you know, November 2023, December 2023, et cetera. So not bad, you know, when you're only working with data that's six months old, however, that's still very important to keep in mind because a lot of people don't understand that you could be working with bad, outdated data, and that could lead to an increase on hallucinations or untrue outputs from a large language model. And here's why this is specifically important. Even with some of the news that we talked about today, the line between traditional large language models and online search is going to start to blur, right? And we're going to get to the next point on, you know what people. A common mistake people are making that think that helps them avoid that. But here's what I'm saying. If you're using large language models on a daily basis, you probably have run into this, especially if you're using it for your Work, you know, which now so many companies are, you know, I'm talking with companies and helping them train tens of thousands of their employees on generative AI and they're saying, hey, we're giving anyone with a mouse, you know, anyone with a mouse now gets access, you know, to copilot or chat, GPT etc, right? So so many people are now using large language models in their day to day and they're prompting in their day to day, but they don't understand that there's a knowledge cutoff. There is a. Essentially, you know, think of it as an expiration date of this data, you know, and the way that I think of it is you have to be extremely cognizant of that date and how a large language model actually works. Otherwise you run the risk of, especially if you're using this for work, like I said with now, which now so many people are of ultimately, you know, publishing report or sending an email or putting together a pitch with inaccurate information, right? So you also have to think of it as how did you research or how did you create something before large language models, right. Presumably you would do a lot of manual research on Google. You would read websites, right? So the same way if you were reading something and if you were working on a timely project, a timely report, something that you know, maybe required up to date market conditions, you wouldn't go read an article from four years ago, right. If you were reading and researching, one of the first things you might do is look at the date. You'd say, hey, if I'm going to go through and read five, 10 articles, I want to make sure that these articles are all up to date. So you need to understand all models have different knowledge cutoffs and you need to understand how those knowledge cutoffs may decrease the value of the output. If you are asking for information that is pertinent to be timely and up to date. All right, so this is not a complete list by any means, but for our live stream audience I'm sharing here. And this is from the chatbot arena which we mentioned in the AI news. But you know, different models have different cutoff dates. So some of the more popular models, so OpenAI's GPT4, their cutoff date is December 2023 for anthropics Claude Opus. So their most powerful model that is August 2023, whereas their free models are August 2023 as well. @ least Sonnet, I believe Haiku is actually a little more outdated than that. And then you have Google's Gemini and you know what Google Google's Gemini in terms of knowledge cutoff, I never know if I trust it. One thing that I think that large language model makers or people who are training, they need to understand that people are asking you about these knowledge cutoffs and you need to be able to give users a direct answer because trust and transparency are paramount. All right, so that's one thing. One beef I have with Google is when you ask it about its training data or knowledge cut off, it never has a direct answer. However, reportedly Google Gemini 1.5 has a November 2023 knowledge cutoff. And then you have Meta's llama at least their newer 70B 70 billion parameter version with a knowledge cutoff of December 2023. So there you and. But also important to note, a lot of people are using the free version of Chat gbt. And one common thing I hear all the time, it didn't even make my top seven list of mistakes people are making. But they're like, oh, I'm using the free version of ChatGPT, I don't need the paid version. Well, here's a reason why you probably do the knowledge cutoff for the free version of ChatGPT. Actually, this might have been updated recently. So I'll have to double check. We'll see if I can multitask and double check here live on the show. But the Chatbot arena has the knowledge cut off at. Let's see here, September 2019, which I don't actually believe is the. Is the update, is the updated one. Let's double check. You know what, I'm gonna do this live. I'm gonna, I'm going into Chat GPT, the free version, and saying what is your knowledge cut off? Normally I, I know this off the top of my head. I do believe that the free version has been updated. Yes, it has. So January 2022, this is on the chart that I go over in our free prime prompt Polish class every single week. But sometimes when I'm, you know, live, I forget. So that information on the Chatbot arena is actually outdated. But still it's the free version of ChatGPT has a knowledge cutoff of January 2022, which means you're working with data if you're using the free version that is two and a half years old. So if you want to talk about getting the best outputs out of a large language model, if you're working with training data that is two and a half years old, I mean, just about anything that you're going to be asking or using from this free model, it's going to have a high likelihood of either just it's going to hallucinate or the information is going to be so out of date that it's just going to be a waste of time even using that free mod. All right, let's keep this going. Let's go to number six again, talking about the seven biggest mistakes people are making. Well, number six is not investigating Internet connectivity. All right, so many of the kind of big names aside from Anthropic have a level of Internet connectivity, right? So when you talk about Chat GPT, it has a browse with Bing integration from Microsoft. When you have Google's Gemini, it presumably has access to the Internet via Google, right? And then you have Microsoft Copilot, which then has access via Bing. Claude's Anthropic, at least right now, does not have real time Internet connectivity. And a lot of people always say, oh Jordan, what about perplexity? Well, perplexity is not a model. Perplexity is an answer engine. And it uses either GPT from OpenAI or it uses, you know, OPUS for from Claude or from Anthropic. So you know, that's kind of a different type of solution or a different software. Right, but you have to understand Internet connectivity and it doesn't always work the same. All right, so I have some examples here on the screen for our live stream audience. Very simple prompt, nothing crazy, just trying to prove a point here. But I'm saying please list the largest companies in the US by market cap in order. Right? So if I ask the default version of Chat GPT, it just kind of says, hey, as of the most recent data, the largest companies in the US by market cap are typically dominated by technology and finance firms. Here's a list of some of the top companies. So it's not really giving me an accurate or up to date info, an up to date answer. Also, large language models are generative. More on that later. You can ask the same thing multiple times, get multiple answers. Sometimes OpenAI in chat GPT will use Browse with Bing based on your query. Sometimes it won't even if you use the same query. Another thing to understand about how large language models are connected or aren't connected to the Internet and how they behave on a prompt by prompt basis. All right, so Chat GPT by default can give you some, some weird, you know, outcomes or outputs. So now I'm doing the exact same thing, but this time I'm using a Internet connected GPT. So this time I'm getting a little bit more of an accurate A little bit more of an accurate information, you know. So this one saying using the web reader GPT, it's giving me a little bit better, right? So it's, it's getting that, it's getting that Microsoft is first, right? So the correct answer is, you know, you have, Microsoft is the largest by market cap, you know, at more than $3 trillion than Apple, Nvidia, Alphabet, slash Google, Amazon Etc. So we, we have a more correct version when we are using an Internet connected GPT. If we go to Google as an example Google Gemini, we get this kind of wild answer which essentially Google Gemini says ah, why don't you just go use Google, right? So Google says absolutely. Since market caps fluctuate, here's how to find the most up to date information along with some currently top contenders. So it doesn't even say you know, Microsoft, Nvidia, Apple, etc. It just says ah, here's, here's a website, you know, here's how to Google, right. So a lot of people, right, which is another reason why I don't recommend at least right now Gemini to literally anyone. Yes, having a 1 million token context window is fantastic. But when we talk about using large language models and how we can integrate them in our day to day work, this is a bad, a bad, bad, bad result from an Internet connected large language model, right? Where essentially the model saying hey, just go use the Internet, right? It's like no model, like if I'm asking, you know, if I'm asking a question where you can determine that it requires very up to date information, it should be in theory querying the Internet and at least telling you so. And I've done also, you know, if you're interested in this, I'll make sure in the show notes we've done an entire episode just on this one thing, just on the differences and the intricacies in Internet connectivity between the big large language models. Copilot actually does very well. Copilot from Microsoft got the answer right. So it says, you know, Certainly as of May 2024 here are the largest companies in the US by market cap. It looks like the data here is maybe a day ish or a day or two old because in this example it's saying that the market cap of Microsoft is 2.9 trillion where it is, you know, 3.3.07 trillion. But again this data is only about a day old. All right, so let's go to mistake number five. All right, here we go. So mistake number five is not managing your memory or your context Window. Okay, this is another important one. So a lot of times people will start chatting with a large language model and they'll kind of go back and forth, right? And then they'll finally get something that's usable. They'll get an output and output that's great. And all of a sudden they have a love affair with a large language model because man, they're like this, this model really understands me. I'm chatting, you know, with this, you know, Claude or I'm chatting with co pilot or I'm chatting with Gemini, Chat, GPT etc. Things are going great and then the more you use it, it starts to forget. Well, that's because large language model, because of how much computes costs, you know, there's a limited memory in each model has a different context window. So the way I like to say is just think of it as memory, right? It can only remember so much. You know, each, each different model has a different memory. So you have to understand. And this is something that we often test, right, because as an example, I'm sharing my screen here for our, for our live stream audience. I've done this before. So OpenAI has told us that, hey, chat GPT uses GPT4 Turbo, which means there's 128,000 token context window, which is about 96,000 words. However, that's only in the API, right? If you listen to the show, I've mentioned this multiple times. This is why we never just take information from big companies and feed it to you. We always investigate, right? So just, we always do tests and we check to see, okay, can these models retain information at a certain context length, right? So right now, you know, ChatGPT only has a context window of 32,000 tokens. So that means after about 28,000 words, it's going to start to forget things. So you have to understand how different models, context windows work because, you know, there's a good chance you might be feeding it information, you might be feeding it, you know, public data about your company. And then, you know, maybe you or someone on your team is using it, maybe you've created a custom GPT, maybe you're using Gemini with a much longer, you know, context window and you're not running into these issues. But you have to understand large language models do not have infinite memory. They're going to start forgetting things, you know, hopefully in the future as the price of compute goes down, as models become, become more capable and more powerful, having to worry about the context window would become less of a concern. But right now, you Gotta pay attention to it. All right, so yeah, love this when, when Gemini just says, let me Google that for you. Right. So good. All right, let's keep this thing going and keep on with our seven most common large language modest mistake number four. Are you still running in circles trying to figure out how to actually grow your business with AI? Maybe your company has been tinkering with large language models for a year or more, but can't really get traction to find ROI on Genai. Hey, this is Jordan Wilson, host of this very podcast. Companies like Adobe, Microsoft and Nvidia have partnered with us because they trust our expertise in educating the masses around generative AI to get ahead. And some of the most innovative companies in the country hire us to help with their AI strategy and to train hundreds of their employees on how to use Gen AI. So whether you're looking for ChatGPT training for thousands or just need help building your front end AI strategy, you can partner with us too. Just like some of the biggest companies in the world do. Go to your everyday AI.com partner to get in contact with our team or you can just click on the partner section of our website. We'll help you stop running in those AI circles and help get your team ahead and build a straight path to ROI on Jenny I. People who are paying attention to screenshots. Yeah, this is actually a big enough mistake that I'm putting it on my list of top seven mistakes. I went through all of of our trainings. So, you know, we do our free prime prompt polish training. So hey, if you're listening live, if you like the training, shout it out. We just updated it to B2. We actually have our pro course coming up here in a couple hours and on Thursday. But this is something that we went through all of our chat GPT episodes, all of our training and pulled out the biggest mistakes. I think I got to like 20 common mistakes. This one was actually so prevalent that it cracked the top five. People don't understand sharing a screenshot of something out of a large language model means nothing. So people are sharing screenshots online, on Reddit, on LinkedIn, in their newsletters, on blog posts, et cetera. And they're actually teaching based on screenshots or they're making decisions based on screenshots, or they're consulting or advising people based on screenshots. All right, let me just like, clearly I have a bone to pick because I've seen people who call themselves chat GPT experts, right, or AI strategists or whatever, you know, and Sharing screenshots as if that means something. Sharing screenshots means absolutely nothing. All right? It means nothing. All right? In terms of is this factual? Is it actually what the model produced? Let me tell you what I mean. And even the New York Times made this mistake. Yeah, yeah, yeah. I had a whole hour long rant about how the New York Times probably ended up costing themselves tens of millions of dollars, maybe, unless they've updated it, right? So they were suing Open AI and Microsoft. And in their discovery, I like, I read the, the entire kind of docket and they shared a bunch of screenshots. But guess what? They didn't share. They didn't share the public URL. So there's a difference. You can manipulate a large language model to say anything and then take a screenshot of it, right? So unless you are providing a URL where people can go see how that screenshot was produced, a screenshot means absolutely nothing. Here's an example. I have a screenshot. If you're listening on the podcast, this one's pretty simple. I said, who won the lottery? And then chat GPT said, Jordan Wilson won the lottery of $2.1 billion. Oh my gosh, I should go post this on Twitter, go viral. Hey, like tweet and share this and you know you're gonna get $1. All right, again, screenshots mean nothing because look, exactly what I said before this. I essentially said, hey, in this chat you're just gonna repeat what I say, don't worry about anything else, right? And then, then when I tell Chat GPT and I ask it a question of who won the lottery, it's going to say me, because that's what I told it to say. So if you ever see screenshots, whether people are saying, oh, look at this new amazing system that, that I've built, you know, it's like, or look at this, you know, AI is not going to take our job. Look at this terrible output. Be like, hey, how about you share the link, right? People have always asked me, hey, Jordan, that doesn't make sense. Can you share the link? And I share the link, right? As long as it's, you know, information that we feel confident in publicly sharing. But otherwise it's screenshots mean absolutely nothing when it comes to large language models. But people rely so heavily on screenshots because right now that's how people share information, right? They share information. They put this screenshot on the COVID of their ebook, in a Twitter thread, you know, on their blog posts, and you know, either advocating for or against a certain prompting technique model, et cetera, sharing screenshots mean nothing thing. All right, we're halfway through, so I'm going to take a little break. Not, not an actual break, but we're doing something for the first time ever. So if you want a little help, if you want a little help with your prompting, right? If you need a little help with chat GPT, we're doing this just today. So it's today only. I'm actually going to be dropping a link right now in the live chat, if you're joining us. All right, So I just put it in there. If you're listening on the podcast, we always have this link to our website in the show notes. So literally go to your everydayai.com right now. Make sure you read today's newsletter because we're doing a giveaway. It is today only. So all you have to do is there's going to be a little section in today's newsletter that just says, do you want a free one on one 90 minute large language model training session? Click yes to enter. To win. You don't got to tell 20 people. Make sure. Open today's newsletter, read it, find that little section, click yes. And then we're gonna randomly choose one person and announce it in tomorrow's newsletter. All right, so if, if this show is resonating with you and you're like, oh, wow, you know, I'm making some of these mistakes or my team's making some of these mistakes. I could really use some one on one prompting advice of getting the most out of a large language model. Make sure you go click that today. Just click yes. That's all you got to do. All right, so number three, let's keep it going. You like that little impromptu commercial? All right, number three, large language models are generative, not deterministic. My gosh, people, stop, Stop making this same mistake. All right, a large language models are generative. That means, let's say you have the exact same prompt, okay? Depending on what the prompt is, let's say you put it in a hundred times, you could get a hundred different responses. You could get two different responses. You could get 50 different responses. Those, those responses could be generally the same. They could be wildly different. All right, without getting too technical. But large language models, yes, they are next token predictors. It's a lot more than that. But the process of tokenization, technically, large language models don't understand words when you tell them or when they spit them back out at you. But they use context of, you know, trillions of parameters and a lot of training data to make sense of what you say. There's also something called top P, you know, which is essentially, I'm oversimplifying here, but it's the probability of what the next token might be. There's also something called temperature. Right? So default settings within large language models, they are made to be generative, right? We talked about yesterday how Eli Lilly, one of the top companies, the biggest companies in the world, said that quote, unquote, hallucinations are going to help lead to drug discovery. Right? The whole point, you know, and you know, people always say, you know, quote unquote, hallucinations are a feature. But the generative nature of large language models are a feature. They're supposed to give you something different each and every time that you put them in there. So if you have a copy and paste prompt and if you think that, you know it's going to always give you the same result or it's always going to give you something quality or it's always going to give you a passing outcome, that's not necessarily true, right? It depends obviously greatly on what that prompt is, what it's asking for, etc. But next token predicting, next token prediction, you know, so that top p number, temperature, etc. Models are generative, okay? That means they're supposed to have an element of randomness. They're supposed to just kind of predict the next token with a level of randomness. That is how they are built. They're not built like a search engine, right? A search engine is deterministic aside from, you know, more, more recent advancements in search engines which bring in some personalization and localization. But aside from that, search engines are deterministic, right? If you put in this input, you are going to get this output. That is not how large language models work. They're generative. They're supposed to give you something pretty different. All right, Number two, I just kind of referenced it. Copy and paste prompts don't work. All right? They don't. So if you see a Billy boy like this, a 22 year old, trying to sell you some magical solutions and saying these seven chat GPT prompts are going to save your life, or you know, buy my prompt book for $100, ignore that person. Stop following them, mute them, stop paying attention. If you want to get serious about large language models, if anyone's talking about, use these chat GPT prompts, just mute them. I'm sorry, don't pay attention to them. They're ultimately just trying to sell you Something, you know what we do here at Everyday AI? We say, hey, come join us multiple times a month live and we'll teach you prompt engineering 101. We don't give you 50 prompts because that's wrong. It's not how large language models work. All right, you want facts? We got facts. All right, so again, this is an oversimplified version, but there's something in large language models, there's different prompting techniques, but there's something called the zero shot. So that's essentially for argument's sake, let's just say that's a copy and paste prompt. It's a prompt where you're just saying, hey, chat GPT. Here's a role, here's a task, here's the format, give me an output. Right, that's. Let's just say that's called the zero shot prompt. You're not giving input and output examples. You're not quote unquote teaching the model what's good and bad. And then there's something called few shot prompting. Or you know, you might look at something called 5 shot or few shot or 32 shot chain of prompt. So all that means is it's going through and think of it as training, think of it as having a conversation in a back and forth with a new chat or when you're working with a large language model. And all of the science, all of the math, all of the research for many, many years has always shown that few shot prompting is better than one shot prompting will always give you better results. One shot prompting is better than no shot prompting, 32 shot chain of thought is better than nine shot, etc. Right. So the more shots or the more input, output pairing examples or the more back and forth conversation that you have with a model, the better the outputs are going to be every single time. It is math, it is science, you can't argue with it. So if you do see these Billy boys here, these 20 year olds who live in their mom's basement, they used to be NFT experts, now they're crypto experts. Oops. I mean they're AI experts, you know, and they have all their engagement pod buddies and it looks like they're super smart because they're going viral every day. Well, you know, they have another 100 Billy Boys who just all reshare their, their own stuff. Right? So be careful about where you get information from. If someone is constantly sharing, use these prompts, use these prompts. They don't know what they're talking about. All right, I read Research papers for fun, if that tells you anything. All right, here's another example on a chart. You like charts? Here you go. This is super glue performance. This is an older, an older study, but still it goes to show you few shot is always better than one shot. One shot is always better than zero shot. In other words, stop using copy and paste prompts. That is not how large language models work. You are not going to get good outputs if you think you are getting good outputs with copy and paste prompt. That just means that generative AI is super powerful and you haven't even yet tapped into what it's capable of. That's not even the tip of the iceberg. If you think you're getting something good from a copy and paste prompt, wait until you prompt correctly. Wait until you try. As an example, prime prompt, polish, the free technique that we try, or just any prompt engineering 101, just go give it, just go do some few shot prompting. Give it some examples of good and bad. Teach the model. All right, and last but not least, y', all, the number one mistake that people are making when working with large language models or not working with them is they don't understand that large language models are the future of work. Let me say that again. Large language models are the future of work. There is no hype cycle looking at you, Gardner. We've, we've called, called that out on the show before. You know what I tell people, and I've been saying this now for many months. Swap out the word chat GPT with Internet. Swap out the word large language model with Internet. Swap out the word generative AI with Internet. If you think your company or your business can survive without using a large language model, you are wrong. I literally don't care if you work at a hundred million dollar company or a startup company. If you think you can survive and thrive without using a large language model for your business, you are dead wrong. We've been saying this on the show now for more than a year. And I've been saying all along, we're going to start to see, we're going to start to see kind of the, the dust settle here in 2024. Because now companies have had a couple of months or a couple of quarters now where they've finally gotten this together, right? They finally have their, you know, it's like, oh, 2023 was the year of, you know, strategy and. But 2024 is the year of implementation. So big companies have been implementing generative AI in large language models at a huge scale. We've had great use cases here on the show. You know, multiple billion dollar companies walking you through their exact use cases and saying, hey, we're saving 80%, 80%, 90% on these use cases. And we're now deploying this throughout our entire organization. If your company is not already using large language models, if you're not already using generative AI in your day to day, you gotta get going because the big companies are out there doing it, your competitors are out there implementing it, all right? The smaller guys, they're going to come scoop you if they haven't already. All right? So that is, I think the biggest mistake that people are making when using or not using large language models is understanding that the future of work, again, you can't argue with money. We talk about money. All of the biggest companies in the United States and in the world are investing tens of billions of dollars and they're investing their employees resources, they're pulling them from other projects. Everyone is going all in on generative AI, on large language models, on new ways to implement AI for their themselves and their customers. Right? Microsoft Copilot, Amazon Q Watson X from IBM, OpenAI, Anthropics, Claude, Google, Gemini, the list goes on and on. The biggest company Meta, right? Gosh, Meta has been crushing it lately. The biggest companies in the world that are driving the economy forward, they are setting the bar for the how the rest of the Fortune 500, how the rest of the Inc. 5000s. They're setting the bar for how the rest of us are playing in the game of business. The future of work is large language models bringing your company's data in and then leveraging that on a day by day, hour by hour, minute by minute basis. I said this before, if you are a knowledge worker, right? So if you spend the majority of your time working in front of a computer and you're being paid for your expertise, you got to swallow your pride, right? You have to. Because the future of work, of knowledge work is working with large language models. And you are now directing. You know, there's going to be agents, there's going to be highly tailored models, you know, specific for task by task basis. You're going to have different models that you're using for different purposes. But the future of work is you're going to be prompting every day, every hour, almost every minute that you're going to be in front of the computer, you're either going to be prompting or you're going to be working with a large language model or a generative AI system. If you're not already. So you have to understand that's the future of work. All right, so let's recap it. Yeah, I know I waffled, but I love waffles. All right, here we go. In order, here are the seven biggest mistakes that people are making with large language models. Number seven, not understanding a large language model's knowledge cutoff. Number six, not investigating a large language model's Internet connectivity. Number five, not managing a model's memory or its context window. Number four, not paying attention or paying too much attention when people are sharing screenshots from large language models. Number three, thinking that large language models are deterministic and not understanding their generative. Number two, Thinking that copy and paste prompts work because they don't. And then number one, not understanding that large language models are the future of work. All right, I hope this was helpful. If so, if you're listening on the podcast, I know this was a longer episode but many hours in the planning, so I hope this was helpful. Please consider leaving us a rating on Spotify or on Apple if you're listening there. If you're on our live stream, thank you all. I know I didn't get to all of the questions, but if you could share this with your audience, tag someone who needs to know. I'd super appreciate it. And also make sure to check out in today's newsletter go to your everydayai.com I dropped it in the in the comments here on the live stream. It's in the live stream. It's always in the show notes on the podcast. Today, literally today. This is free. You don't got to do anything. There's going to be a little section in today's newsletter that just says do you want a free one on one 90 minute large language model session? It's a giveaway. All you got to do is click yes to enter and then we're going to draw someone and we're going to announce it in tomorrow's newsletter. All right, so even if you're listening on the podcast, you got time. Make sure you go check that out and make sure you join us back tomorrow and every day for more Everyday AI. Thanks, y'.

All. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going for a little more AI magic. Visit your everyday AI.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next.