AI predictions for 2024

Foreign.

Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI related tech is changing the world, this is the show for you. Thank you to our partners at Fly IO, the home of changelog.com Fly transforms containers into micro VMs that run on their hardware in 30 plus regions on six continents so you can launch your app near your users. Learn more@fly IO.

Welcome to another episode of Practical AI and Happy New Year 2024. Chris and I are starting out this new year with a fully connected episode, which are those episodes of our podcast where we keep you fully connected with everything that's happening and the AI news and trends and help you level up your machine learning and AI game. I'm Daniel Whitenack, I'm the founder and CEO at Prediction Guard and I'm joined as always by my co host Chris Benson, who is a tech strategist at Lockheed Martin. How are you doing Chris?

I am doing very well, Daniel. Excited for 2024, I suspect. You know, like we keep talking about how 2023, such an amazing year for AI and we're about to go through some of that, but I'm pretty sure 2024 will be even better.

It's interesting. I was just having a conversation with one of my friends and mentors yesterday and we were talking about the kind of curve of adoption of this technology and where we thought we were in it. He kind of sketched out this trend of early days, right? Where really what you are investing in is research and development, right. And then there's sort of a usage expansion, adoption period where what you're investing in is usually developers to actually build out things at scale, right. And then you kind of like reach this place where what you're investing in is lawyers because everything's consolidating and like there's more, you know, regulation, lot of mergers and acquisitions, right. And so everything's kind of consolidating in, in together. I'm curious to know what your perspective is in terms of maybe let's scope it to generative AI since that's pretty much what we've what 2023 was kind of about and certainly not what all of AI is about.

But I mean 2023 was the year that big tech dived into AI for real. Like they had been talking about it and doing it, but it, you know, suddenly the whole world went AI, you know, with chat, GBT catching on the way it did and and its competitors. So big tech is all over it. But there are many challenges to that and you kind of just talked about that process, about working your way through the challenges. And so there hasn't been the killer app. You know, there have been really interesting things to come along and some of them occasionally are revolutionary. A lot of them are revolutionary. But there's still a lot of organizations, a lot of businesses specifically out there trying to figure out how does this work for us. And, and there have been some stumbles along the way. So I, I think, I mean, I think 2024 in that sense is more of the same of investing a lot in AI, not so much for today, but for getting ready for figuring it out for tomorrow. So I think we'll see a lot of, a lot of that. Two steps forward, one step back.

Yeah, I kind of had a similar thought. I saw some study, I, I actually don't remember which one it was off the top of my head, but it was one of those that surveyed a bunch of enterprises or something like that. And something like 15 to 20% of enterprise companies actually had either kind of something prototyped or some type of integration to an AI system. Maybe that's just a simple integration with, with an API or something. But if you think about that, there's. It's definitely kind of at that beginning. I would say we're kind of past R and D in the sense that, not that R and D is not important and new things will be discovered as they continually are. But in terms of the technology that has sort of dominated the news cycle in 2023, we're moving past the heavy R and D investments more into the like, how do you scale this with software engineers developments? Like if you're a company developing these technologies, you probably are going to not win by doing R and D. You're going to win by creating, like you say, products, the applications, the platforms, the APIs, the systems that power this kind of growing adoption within the enterprise. So I think where you saw that kind of adoption start in 2023, that's going to expand very rapidly in 20 for. And those that keep up with that in terms of actual software and system development will likely be in a good.

Place, kind of extending that a little bit. Another huge trend we saw was in years past, we've talked a lot about the process of doing the R and D and how you're kind of self hosting or how you're using cloud, but you're still driving it yourself in a lot of ways. And what we're really seeing now is as the marketplace for AI, you know, integrations is exploding, is that These large tech companies, the Microsofts and the Googles and the AWS's, you know, the big cloud companies, are really making a lot of AI usage about API usage, you know, and it's AI by API. And I mean that's essentially Microsoft's entire, you know, primary play right now is to take OpenAI technologies and package them up in their own products and push them out. And we're seeing a lot of uptake on that from organizations that, that maybe struggled with their R D a bit in broad maybe, you know, and I'm not talking about necessarily the leaders in the AI space, you know, the, the most select group, but, but the second, the third tier and the fourth tier companies out there are kind of going, I'll just use what they've made available to us via API. And that's good enough. And a lot of strategy, a lot of business strategy is being built around API access. So it's becoming software, you know, like so much other software.

Yeah, and some of that will likely get more commoditized as other API products have been sort of commoditized over time. And so open source is coming. Yeah, it'll be interesting to see how people develop their competitive moats within that space in 2024. I think it's a year where probably there'll be some people that really come out ahead and some people that suffer very badly because certain things are just becoming more commoditized.

I think you're starting to see companies realize they can't just say, we have AI in our product now. You know, we had a period where, you know, having AI being able to say how we have AI was a marketing ploy unto itself, but as it becomes more ubiquitous and more common, that's not going to work anymore. Your point there about differentiation is going to be key and human creativity to find what those opportunities are.

I was looking back at some of the developments that happened in 2023, and it's amazing how much was packed into that year. Yeah, some of that I was like, did that really happen and did that also happen in 2023? It's like, yeah, it was a year, man. So much was. Was packed in. I'm wondering what are some of the highlights that you saw in terms of things that happened in 2023 that we either commented on or didn't comment on or that are kind of highlights in your mind from things that we discussed in 2023 that are kind of informing your perspective as we go into 2024.

A couple of the big highlights and we can dive into whatever we want. Are at the tail end of 2022. ChatGPT was released early in 23, I think it was that we had GPT4, you know, added into that underneath it from. From the chat GPT. I'm sorry, from GPT3. And then they updated that with 3.5. And that kind of kicked off the firestorm at the beginning of the year. And we saw Google scrambling, you know, to try to catch up. They got barred out. And then they came along late in the year with Gemini to back it up. We saw Meta coming out with llama 2, we saw anthropic coming out with Claude 2. And so there's now a whole industry. You going into 2023, there weren't so many options, really. And, you know, ChatGPT kicked off the arms race in the industry. And it's interesting is that I know that for me, as we were going through the year and all these crazy things were happening, it was a new week and a new model to try, you know, and I had my standard tests, I had the things that I cared about, which were usually avoiding the things everybody else was doing. Like, everybody would ask for Python code from the models and that's the best language you can possibly ask for. So I would. I would ask for Rust. And they were all just, they were all failing all over the place. It was miserable. Like. Like you could have all these top models and they were doing great in Python because that's what they were really centered around. But in Rust, they were really falling all over themselves. It's starting to change a little bit now. But that and a few other things.

We both may or may not be able to comment on everything that is actually integrated in our daily work. But you as a. As a person, a developer, a strategist, as we went through 2023 and ended up at the end of 2023, your own usage of AI products, what did you. How was it impacting your daily work in ways that were different at the end of 2023 than at the beginning of 2023?

I think 2023 was truly the year where I never put down the various model interfaces.

You mean like the ChatGPT or Claude or whatever was up in a window, right?

Yeah, things like that. Exactly. And now when I open a browser, I have kind of a bookmarking app in my Chrome that does it, and across the top of the screen I have all the models that I use, and. And on any given day, I probably use every one of those. And often for A problem. I will go to all those things. So it really became the year that it integrated into every part of my workflow. And it didn't matter if I was coding or if I was having to write something. And it could be, you know, technical related or. Or not technical related for my animal nonprofit, you know, that I, that I. We talk about occasionally. I use that for that, for a whole bunch of different things. So it wasn't all centered around the AI world or the coding world. It was kind of every aspect at the dinner table. My daughter, who's 11, she's in sixth grade, and I would challenge her, she'd say, well, my teacher doesn't want me to use that interface. And I kept. I was inevitably saying, well, that teacher's dumb because this is part of our life they need to get used to. You know, this needs to be integrated into teaching instead of being afraid of it or something. But I started showing her how she could learn more. I learned faster by using the tools. And so it was a dinner table thing for us. So that was it. I mean, I'm living the same. This kind of the same experience that so many other people are, that using these technologies is now completely built into everything that I do, no matter what that activity is. Short of swinging a hammer, I think that's the biggest thing for me is it hit work, it hit side job, the nonprofit, it hit all my personal life, it hit my. My kid's life. And so anyway, yeah, it's the year that changed me from an AI perspective.

Yeah, that's interesting because we've been doing this for what, five years now. And yeah, most of that has certainly been impact from deep learning, machine learning over time in the enterprise setting, and value that companies have definitely gained over time with those technologies. But mostly it sounds like what you're saying is mostly like you were working in that space and helping develop some of those things, but in terms of the way that you did your job, it wasn't like those things were tightly integrated into your activities. Is that a good way to put it?

That's a good way to put it. I would set aside time to do activities in the space, and that was part of either my day job or us on the podcast or whatever, but those were. And then I would turn away in years prior to 2023. So I think the fact that it didn't just integrate into one of my workflows, integrated into all of my workflows across all the, all the opportunities there, and using one against the other and taking the Output of one and putting it in the other and things like that and just trying things out. That's what it was. And I suspect that it was the same for many of our listeners.

It's interesting, Chris, that you mentioned impacting kind of your whole family's lives. So one of the things that I did for Christmas, I have a bunch of nieces and nephews and it's always, you know, well, my wife and I don't have kids. A lot of my life isn't dominated by thinking about like what kids are interested in these days. So sometimes it's hard to figure out Christmas gifts and, and all of that. I have to do a good bit of inquiries with my brothers to figure out what to do. But one thing I did this year was I just created like a framed picture. So I know each of them have like certain interests. Like one's really into electric guitar right now, right. And one of my nieces is really into frozen or whatever. So taking something from each of those, like took a, you know, an artistic picture of someone shredding guitar on, on stage and then basically deep faked my nephew into the photo and like stylized it with all. I did all that with clip drop from stability. So like, you can go in, you've got like, oh, here's the. I can go in first and just remove the background from the image and then like generate the scene, right? And then face swap the thing and then you can clean up certain areas or remove objects or change the lighting. And all of that, you know, happened like very seamlessly for me. So it's just interesting. Even in that, that context, that's what I turn to.

You know, it's funny. And I did the same, like a lot, a lot of picture generation and stuff. Lots of raccoons and foxes and stuff. And in various scenarios, I'll share a two second touching moment that just caught me off guard. I work with a wildlife vet in the, in the animal nonprofit and they do a lot of stuff for free because we're nonprofit and we're doing all this good. And they love these animals and so they just help. And I'm very thankful for that. But one day I had come home after taking some animals in for them to, to help that were beyond my ability. And I just sent them a text saying thank you. But in the process I went and, you know, generated an image that showed their veterinary practice and all that and some animals around it and I sent it and it was like a 2 second thing for me. I didn't. It was like just like, oh, I hope you like this. And they took, they, they received it but they're not people in AI. They're not, you know, they, they're not as tech focused obviously as we are. And she had it printed out and framed and put in the main office like where people could see it and everything. And I was just like. That never occurred to me. But it made me realize that even these completely non tech things, AI is something that can help people that are not focused on AI still find value in their activities in, in ways that maybe some of us who are talking about this all the time don't think about. So yeah, it was kind of an amazing moment to see something that so trivial turn into something that was meaningful for them.

Yeah. And one major change for me which in the past. So those that have listened to the show for some time, you might be aware that I've always coded in vem. That's been my IDE of. Of choice. This was the year that I was finally motivated to. So I actually changed my editor. So I'm using VS code now.

Oh my. He came over. I can't believe it.

Yes, with codium. So I've tried VS code in the past. I'm kind of like okay, cool. Like I like there's things like the searching or completion or function finding stuff that's all useful but you can do all that and in vim easy enough. And I know there's also integrations of AI stuff in vem, but I found that that really tight workflow and having even a chat interface within VS code through codeium was actually just like so efficient for me. So I felt like I was able to be way more productive as an individual contributor this year. Even in ways that would have been very difficult for me before. So writing like different typescript stuff or other things that is not natural for me. I don't know a lot about that. Whether it's that screen and VS code where CODIUM is or hopping over usually like you, I also have my, my Chat GPT window up and I'm asking questions back and forth there. So it's kind of a combination of these things. It's not maybe completely seamless, but it's just so efficient and I love now you kind of saw that progression. It was really powerful for developers I think this year. And then recently now you're seeing more privacy conserving options popping up. There's a project called continue.dev or continue. I'm not sure what they prefer but it's an sort of open source integration of this kind of VS code type of interface. But with you can choose the model that you want to use. You can integrate an open model like Wizard Coder or Code Llama or something like that. And so I think it's cool that there's a lot of really seamless configuration of that for individual contributors. And the feeling I never got was, oh, this is taking over what I'm able to do. But by embracing that, I was able to be so much more productive as an individual contributor.

I was too. I mean, and this year I'll have periods where I'm coding and I'll have periods where I'm not. And it kind of goes in and out. This was, this year was definitely dip back into coding and there's always the kind of catch up to where you were moment when you've taken time off. But it was different this year because by embracing these tools that we're talking about, it let me catch up and it let me do things that I would have taken time and struggled with before by using all these new amazing tools. So and, and we're seeing that across so many things that you, you don't have to be a developer to benefit from this. So I think 2024 hopefully will be the year where people discover productivity instead of just kind of entertainment. Because most of the things I'll see on, you know, Facebook or people that are not really technical and they've discovered how to generate images and stuff like that and they'll, they'll do that, but they, they haven't learned how to, to really change their lives the way we've been talking about. I'm hoping that that starts to transform folks and takes maybe some of the fear of AI away because that was, that was the other thing I really noticed a lot of this year was fear of AI. I'll walk into a room and I'm ready to talk with anybody about AI and all these cool things. And I kept hitting walls of fear with people who are not in the industry. And every time I did it, it always surprised me. I think I'm just kind of. Because I'm so upbeat about things. That was another thing is maybe 2024 is the year I'm hoping that some of that fear gets mitigated and people discover productivity instead.

I mean, there were definitely a good number of things in 2023 that led to a chaotic feel in the industry. Whether that be the sort of hiring and firing of Sam Altman or disclosure of like data breaches of one kind or Another, we ended the year, of course, with New York Times. I don't know if it was 2024 or 2023. I'm assuming they had to file things in 2023 where the New York Times is suing OpenAI, which is definitely in the, in the news now for, for copyright stuff. So, yeah, there's a lot of, if those are the sound bites that you're getting, it definitely doesn't lend itself to thinking that this space is reliable and safe and trustworthy.

The flip side of the coin on the fear is that this was also the year that we saw significant policy and regulation initiatives being put in place. You know, we had the executive order that came about in the US Within Europe, they had the AI act late in the year and that that made a big difference. And we have talked about a lot of this, by the way. You know, obviously in the show, and I would refer listeners back that many of these things we've discussed here are in, you can find a dedicated episode on some of these things on our show. So look back through that. But in general, as I'd moved to, and I mentioned this on a previous episode, move into family or go to and hang out with some folks that had nothing to do with AI and they don't know what to believe. I saw, I think another thing that got pointed out to me several times is that you'll have, you'll have big names in our industry that are big enough to make it into mainstream. People like, you know, Yann LeCun, he famously considers it ridiculous, you know, that there's fear of AI and stuff like that. And then you had Geoffrey Hinton on the other side, another one of the major names who left Google so that he could talk honestly about the dangers of AI. And so you're talking about two global luminaries in the space that were actually recognized together, you know, recently as pioneers, and yet they have polar opposite views about that. And so if you're, I think that's hard if you're in the industry, but if you're not in the industry, you have a lot of trouble trying to figure out who should you believe when you're, when you get a, you know, a New York Times article or something like that, you know, that addresses these issues and you go, how do I handle that? So I'm hoping that 2024, maybe we can pick up a few new listeners, maybe some of those that are interested in the topic but don't work in the industry, but maybe they can get educated a little bit more on kind of what the space looks like.

Yeah, well, thinking about more forward looking things and into 2024, I know we want to talk about some of the maybe hot takes or non hot takes that the people had in making predictions about 2024. Before we do that, I'm wondering, Chris, if you have, I can give mine first, but if you have any, any hot take or, or spicy opinion that's maybe not represented in kind of the overall like what everyone is saying, I can give mine first and no worries if you don't have one. But mine. I think that I, I saw a lot of people, you know, posting on Twitter, LinkedIn. Here's my predictions for AI and 2024, mostly all of them having to do with, you know, generative AI and utilizing those models as the key piece of a workflow which I, I started a company to do this. So I don't disagree that that's going to be a big focus, but maybe my spicy take that's kind of different from many people's is I think that we're going to start to see. There were a couple of takes that I saw that said something about like the software engineering element of building out these systems being a key piece of what will be important in 2024, not just making prompts. I would kind of build on that a little bit and propose that I think there's going to be some people that are really going to win by combining the kind of quote, traditional data science and machine learning algorithms or models or systems with generative AI systems in a sort of hybridized way. And I say that because in our own client work I found that to be very much the case. And a very, very powerful approach is, hey, you know, in this case we're, you know, generating responses for customer emails or something. And I don't want to generate a response when the customer is really frustrated or something. I'd rather a human respond in that case and not the AI. Right. Well, the best way to figure that out is I think with a sentiment analysis model that we know how to do really, really well and we can run on a CPU with very little cost. Right. And then we can use the generative AI to answer when it makes sense or maybe even informed by the sentiment label.

Right.

And I think that's only a very simple example. But you know, combinations of recommender systems, gradient boosting machines, time series analysis with generative AI models, either large language models or other types of generative AI models, I think that's a really powerful combination that many people are Kind of ignoring. It's like they've sort of moved on from the past. Now we're in this zone. I kind of have the opinion that we're going to see a little bit more of that, kind of make a resurgence in 2024 and be combined in interesting ways or with hybridized systems. You may not see it in the news as much, but I think on the battle lines within enterprises, it's something that you're going to see a lot.

I think that's a fantastic, not only a fantastic prediction, but a very practical prediction as well. So you caught me off guard with the word spicy a little bit. There are many predictions I would make, but many of them are fairly mundane and in alignment. They're kind of the logical thing. So while you were talking, I kind of wiped all those off the slate because, because you said, you know, spicy and different. And so I'll. I'll make two. I, I. One is, I think Prediction Guard is going to really take off in 2024.

Let's hope.

I'm sure it will. But here's my spicy one. Here's my. Because I think that that was just a given. That's inevitable. You've done a great job with that. The spicy one is, I think that there is generally going to be a resurgence of interest that we've started to see develop again in 2023 around artificial general intelligence. AGI and I. I'll tell you why I'm predicting that because we have seen in the past year these models make such a leap depending on how you want to measure what a model is capable of in terms of different measures of intelligence. There's, you know, people talk about, there is intelligent, they're super intelligent, they're almost as intelligent. And I think it depends on how, what kind of metric you're using for that. But, but I think as a generalization kind of looking at all those, we're seeing these models that are incredibly productive. And if you're measuring intelligence on, in terms of productivity and you're comparing that against what a human would be able to reasonably do in the same time period, we're seeing output from these models that we've been talking about, that's just amazing, which is why you and I have integrated them so heavily into our lives. So if you take that for a moment as a measure of intelligence and then you say, well, there are about roughly a dozen different ideas on what consciousness and, you know, would be in the space. They don't agree with each other. We've made it nowhere but there's a lot more fear now, and fear tends to drive priority, as I've learned in the industry that I'm in. And so the general fear out there is when you have such capable models, if there is a worry that we don't understand, we see in nature all around us, that consciousness arises in animals all over the place. It's probably mathematical in nature, but we don't have anything. So I think that there will be a resurgence of research. I think that that research will not come in the AI space, that will come in the neuroscience space, trying to understand, because the big fear is what happens when we stumble upon it. And you have already have such productive models. And so I've run into that fear over and over and over during 2023. So I'm predicting, not terribly practically, that there'll be. There'll be a focus, at least in some quarters, about how do we ensure that we don't hit a moment that comes with big surprises in the large. I like that we have very, very different predictions on this one, but that's my spicy prediction.

This is a Changelog News Brief Break Curl creator slash maintainer Daniel Stenberg documents his frustration with recent AI tooling advancements. Quote I have held back on writing anything about AI or how we do not use AI for development in the curl factory. Now I can't hold back anymore. Let me show you the most significant effect of AI on curl as of today, with examples. End quote Daniel is clearly of the opinion that we haven't gained much of value from generative AI tooling, but he does seem more optimistic about the future than he is about the present. I am convinced there will pop up tools using AI for this purpose that actually work better in the future, at least part of the time. So I cannot and will not say that AI for fighting security problems is necessarily always a bad idea. I do, however, suspect that if you just add an even so tiny intelligent human check to the mix, the use and outcome of any such tools will become so much better. I suspect that will be true for a long time into the future as well. End quote. My mind is open and willing to be changed, but I'm with Daniel here. The human touch is absolutely necessary today, and I suspect that will remain the case for much longer than some would have us to believe. You just heard one of our five top stories from Monday's Changelog News. Subscribe to the podcast to get all of the week's top stories and pop your email address in@changelog.com News to also receive our free companion email with even more developer news worth your attention. Once again, that's changelog.com news.

Well, Chris, one of the things that we did leading up to this conversation was take a look at dozens of these. This is what I'm predicting for AI and 2024 posts on Twitter and LinkedIn and kind of crystallized down or distilled down some trends of what people were predicting. So I'm going to take what I kind of distilled down from all of these posts and I'll just put it out there and we can comment on any of those. Then it may be interesting to look at, you know, a couple of these from specific people. That might be interesting because a lot of, a lot of people have been making these predictions. So I did not do this with AI, but if you actually just look through the Internet at these posts, you'll. You'll see some trends pop up of what people are predicting. And I think both you and I looked at these and said, yeah, these are kind of what would be expected to be predicted based on. On what we've seen in the conversations we've had recently. So the common points that were predicted by many different people across the interwebs, I put them in five categories here. So I'll just read them off and then we can make a comment on any of them if you want. So rag or retrieval augmented generation will continue to be a focus and will experience various improvements. So that's number one. Number two, open models will beat GPT4 in 2024. Number three, productivity in work will be enhanced by AI rather than replaced by AI. Number four, multimodal models will be more of a focus in 2024. I actually think that was one that I predicted last year when we did our predictions. So maybe I was a year off. So there you go. I was a year off. And then number five, there'll be more focus on small language models rather than large language models because of economic and compute efficiency. So those are the five that were kind of distilled out of a bunch of different Twitter LinkedIn blog posts. Any of those strike you as particularly interesting? Chris?

I agree with all of them. And these were some of the ones that I disregarded for the spicy one that I made that would probably make half of our audience roll their eyes. But. But maybe all of our audience.

What's the good in listening to a podcast if you can't roll your eyes sometimes?

If you can't roll your eyes from time to time. But yeah, I think these are all Very, very practical, fairly safe predictions. I think that probably most of us that follow the industry closely would tend to say, actually since they came from many posts would tend to say that's the thing. And I said, and I'm looking forward to that. The, the multimodal thing in particular is something that I've been waiting for in 2023. I was like, okay, but. Okay, but come on. So that, yes, I, I agree with everyone that's there and I think that's the logical progression. I would be very surprised if they don't all come true this year.

Yeah, probably a lot of these are a given. There's definitely some open models that already quote unquote beat GPT4 in certain respects, like certain tasks or something like that. Like if you think about maybe generating SQL queries based on a schema, or if you think about like doing this particular thing in this language that's not English, or if you consider like specific domains or other kind of specific tasks, I think you already see that to some degree. Now GPT4 is this sort of general purpose model that does all of these things at a pretty incredible level, but I think we'll see open models get much, much closer to that. And you've already seen a lot of that kind of being hinted at with models like Mixtral from Mistral, which is a mixture of experts model similar to in that sense, mixture of experts sense to GPT4.

And I think we're, we're already kind of seeing a lot of that happening. You know, to your point, if GPT4 remains king at the moment, it's not king in everything and different taskings work better. There are some things I found llama2 work does the best at. There are things I found this, you know, Gemini, which is still quite new, just a few weeks old from its release, is good. I think right now I'm getting better rust out of Gemini than any of the others. And so that's one of those things where we're kind of learning what model to go to for different tasks with GPT4 probably having the best overall return rate in a generalized sense still. But that will certainly change this year. You know, there will be, it will probably change multiple times.

I found some of the comments on specific ones of these interesting from particular people that are especially well positioned to comment on some of these items. So for example, the number five one, the focus on small language models, but also with the perspective of becoming more economical and cost and compute efficient. Clem from Hugging Face the CEO made a video which is really nice. I recommend everyone watch that on Twitter or other places that it's that it's posted. But he, he made some comments about his prediction that one of the hyped AI companies, certainly a lot of them now, would go bankrupt in 2024 or get acquired for low price. And he tied that in with the comments along the lines of cost efficiency and focusing on cost of running these models because yeah, you likely have a lot of startups that have raised big money. Their compute costs are probably astronomical because they're running these large models at scale and hoping that their margins get, get better over time. But once you make the shift to open models and cost efficient models, that may not work out in their favor. And so the ability for people to run models in their own infrastructure, run more cost efficient models, that's not going to play out well for certain people, but it will play out well generally for the costs of running these sorts of systems and enterprises, whether that be it still could be a software system that runs LLMs and is self hosted within an enterprise, but it's going to be much more cost efficient to do that, especially kind of for those that are wanting to pull some of that in, not rely on external systems, be more privacy conserving, not have data leave their infrastructure. That's going to become more and more possible. And so yeah, I thought it was interesting how Clem tied together some of these of his predictions around yes, being more cost and compute efficient, which is a benefit to the climate for those that are thinking about those things, but also cost efficient in terms of enterprise and operational costs and how the focus on that will not work out that great for certain of these kind of.

Hyped AI plays kind of as a follow up to that I saw it was a few days ago and I'm going to paraphrase because I don't have it in front of me but he I did a social media post that basically was an appeal to teams out there and saying listen, if this year you're at the end of your financial run and you want to keep doing the work and you want to keep your team together, reach out to us at Hugging face and maybe, maybe you can join our team and keep doing some of the same stuff in that way and you know, with our, with our infrastructure. So I think and which, which I think is a very natural follow up to him pointing out that, that we'd see some crashing and burning otherwise in there. So. And a smart move on his part as a CEO.

Yeah, yeah, definitely it's Great to see that. I think there will be some of that, some of the hints of that this year. I don't think we're in that sort of like hire lawyers and consolidate phase yet. We're still in that kind of building and engineering phase. But just the economics of how things are shifting will, will shift, I think in, in 2024, which will be interesting.

Yeah, I think it'll be. It. The finances of it all will matter going forward. Instead of just building and building, you'll. We'll see a building, but a building with a practical eye on how do we sustain this over time.

So yeah, for sure. And I know one of the other ones that I think is very well positioned to make a comment on the things that he was making a comment on is Jerry from Llama Index who was on the show. Well, Colin was on the show too, but Jerry more recently and of course llamaindex is one of the key frameworks that's being used within rag workflows. And he also made one of the comments around the way he phrases it as every AI engineer still needs to have strong software engineering fundamentals. So shipping, this is quoting him, shipping an LLM app to production reduces to software engineering and clean extensible abstractions, testability monitoring and production, et cetera. So yeah, I think that that insight is very fair and kind of gets to this really need for software development practices to kind of gather around the LLM practices and model calls within 2024.

So I'm glad that you brought that up just as a quick add on to that. We've seen a lot of kind of AI specific language around, you know, producing AI capabilities and such as that. But you know, a lot of phrases have been coined in that way. I think that's important is that at the end of the day, AI remains a really cool new capability within the larger software space and to do anything with it, you have to have a software capability and that those two are gradually merging. And someday when we're past the kind of the coolness of the AI and we're all just like, oh yes, we've been doing this for a while and it's not quite such a big deal, it'll be software again and all software will have it and it will just be another aspect of software. We're not there yet. We're very much in the cool space at this point. But software skills remain important. And some of those may be human driven and some of those may be driven by the software with models, but that doesn't change going forward, you're still.

Going to need it. Yeah, I'm looking forward to learning with you in 2024, Chris, and talking through whatever comes, which will certainly be different than what we just predicted. As is always the case every year that we try to do this, it's always different. But I am looking forward to navigating that journey. And thank you to our listeners for being loyal and engaged in 2023 and really happy to continue bringing you this content and learning with you all as well in 2024. If you haven't yet, make sure you go to changelog.comcommunity. you can join a Slack channel where you can chat with us if you like and connect with us on Twitter and LinkedIn and and all the places were Blue Sky. Yeah, exactly, Blue sky. And we'll love to hear guests that you want on the show or topics that you want discussed and chat with you about all the cool stuff that you're doing. So thanks for a great 2023 and Happy New Year 2024.

Happy New Year to you too and everyone listening.

All right, that is Practical AI for this week. Subscribe now if you haven't already. Head to PracticalAI FM for all the ways and join our free Slack team where you can hang out with Daniel, Chris and the entire Changelog community. Sign up today at PracticalAI FM Community. Thanks again to our partners at Fly IO, to our beat Freaking Residents Breakmaster Cylinder, and to you for listening. We appreciate you spending time with us. That's all for now. We'll talk to you again next time.