Capabilities of LLMs 🤯

Foreign.

Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI related technologies are changing the world, this is the show for you. Thank you to our partners at Fastly for shipping all of our pods super fast to wherever you listen. Check them out@fastly.com and to our friends at Fly, deploy your app servers and database close to your users. No ops required. Learn more@flyio.

Welcome to another episode of Practical AI. This is Daniel Whitenack. I'm a data scientist with SIL International and joined as always by my co host, Chris Benson. How's it going, Chris?

Going very well. Spring is in the air. We're having a good time here. Lots of cool stuff in an AI world.

Lots of new life breathed into interesting AI systems over the past days. And sometimes I hear about this in cool videos, which are way cooler than any videos that I produce. From our friend Raj, who's with us today, Rajiv Shah, who's a machine learning engineer at Hugging Face. How are you doing, Raj?

I'm doing great. Thanks for having me on.

Yeah. So the last time you were on the show, we talked about data leakage. Have you leaked any data since the prior episode?

I think any data scientist that's out there has leaked data on a regular basis like that. Right. It's a hazard of the job. And, you know, one of the things I like to do is continually remind the new folks that that's likely to.

Happen, that they are in the process of and should remember. Yeah, yeah. I did mention I've seen a lot of cool videos from you recently and we were chatting even bit, I think on LinkedIn about there is data science AI community on TikTok and other places. Tell us a little bit about that. I'm just, I mean, that's a fun topic. I'm curious of what is the AI scene like on TikTok?

So let me start by, like how I got into it. About like a year ago, I was trying to get my son, who's just starting college, to do a real practical project around AI. Like he's taking computer science, but he doesn't know what GitHub is. So I'm like, can we build a discord bot, for example, something that appeals to him. And so I was like, let's give us 24 hours, we'll do this over the weekend. We'll both go our separate ways and then we'll come back and kind of see what we've done and see if we could share what we've learned from each other. And so I go out and I go get a blog tutorial and work my way through it and kind of get something working. And then I go to him the next day and he's like, yeah, I kind of got stuck. I was like, well, let me see if I can help you through it. Like, show me the steps and what you were accomplished in doing it. He pops open a YouTube video and that's what he used to follow it. And for somebody like me who self taught their way into data science that was largely focused on kind of reading and written material, it kind of really blew my mind that somebody would learn how to code through a video. But it really just opened my eyes to that because already at that time, like with my daughter, I shared videos on like food and politics and music. But it just really came to me like how this is just becoming an emerging part of, of education and how people learn kind of as we move on here.

Yeah. And have you seen like engagement with your videos on? So like I remember the one recently I saw was like the what is it? Segment. Anything or everything. I forget which is anything and everything. Whatever that one is. I saw your video on that one, which was cool because it's also very engaging. You've got like this skit element to it, but there's real information content in there. Right. In an engaging way. How do you see people respond to these?

So I've had great feedback and I try to keep mine very focused on data science. I try not to be too clickbaity. I try to be like, you know, if I was on a data science team, would I recommend somebody to watch the video like that. But the video style also lets you do different things. So I think when I first started videos, I did, you know, I used to be a professor. I did like the traditional, let me just lecture you on this topic for 30 seconds. But like I think as you mentioned, over time, like there's more creative ways of doing it. And one of the things TikTok allows you to do is often tell it in a story or skit format where you can have the voices of multiple people if you're sitting at home on your phone. That's a much more interesting way to like get a nuanced conversation rather than reading kind of some blog post that has here's four different points on this. So, you know, I think there's a lot of potential for kind of teaching nuance with something like TikTok.

Yeah, that's cool. And there's no shortage of things right now. To talk about. It's like you probably are more constrained on your ability to pump out these videos than like the AI things that are coming out. We've all had our minds blown recently, especially the capabilities of large language models. But there's also of course other things in computer vision and other things for you. What have been those mind blowing moments or what has been on your mind over the past? I can't even say, like the past year, like the past two weeks. I don't know.

I don't know. So I think we just have to look back and reflect that we're really in a great place of a huge amount of innovation in a short amount of time. Like this is one of those peak times in AI that it won't be like this a year from now, right? It wasn't like this two years or three years from now where literally every week there's new developments. It's a fabulous time. If you're an AI junkie and you like to kind of check out and see the newest tools and see that incremental advance like that, there's no better time. It's not going to last for long. So kind of enjoy it. I also kind of also push back on this for lots of practicing data scientists that are very practical that you know, you don't need to watch this stuff every day or every week like that. Like many of these things are exciting. But if you're day in and day out, you're an enterprise data science, you're inside doing churn analysis or some marketing analysis. Many of these developments are going to take a while before they filter you to you. You'll have plenty of time to get up to speed. They're not going to change the face of every data scientist in the next two months like that.

So I'm curious, it's a follow up to both of these last two questions combined. You're going into different mediums now for teaching. You're hitting short video, longer video, different things. You're. We have all of this happening so fast. How are you thinking about reaching different audiences in data science? It's kind of funny. Once upon a time it was just data science, but now we have different audiences, different age groups, different purposes. How are you making those different connections?

I was just talking to someone today. Dr. Koppa is like students coming into college now can't type. Typing isn't a thing anymore, right? Because of the way they've grown up with devices, right? Like they can poke and like touch screen, but that's gotta influence like if we're not adapting to that, then we're not staying up.

Right? Chris, you just made me feel really old.

And I think one thing that's happened is like data science came out of statistics and for a long time, right, the path to learn that was you went to college, you sat in a classroom, right? You had a statistics book to do that. But I think this is the transformative part about AI and data science, where now it's touching so many people. And especially you see this with these large language models where if you're a teenager, you have a GPU all of a sudden now you can kind of download and follow a script and get something running on your local machine where you can interact with this AI, right? Which a couple years ago would have been unheard of for somebody to have such wide access to that. So I think the hard part about communicating to so many audiences is also a great part that we have such a large community that's engaged and interested and wants to use these tools.

I'm going to bring a couple things here on the fly for you, Raj, because you are so good at explaining these things. So I'm at a conference right now. So I walked from a talk over back to here. And yeah, one of the things that they were talking about was in context learning with large language models. Models, could you kind of help us? So we've talked a lot about on the show about prompting large language models, this sort of thing, but I don't know that we've specifically kind of talked through this, like in context learning, like, what does that exactly mean and what should people take away from it? Maybe.

So if we look at the development of these language models, a couple years ago, if you look at there was blog posts by Carpathian kind of working with LSTMs and how we could get these models to generate text for us. And this is where we have the statistical probabilities of being able to put together text and it knows the cat ate the dog or that there's some probabilities and we could put a sentence together a couple years ago. These were fantastic things at making really weird stories. That's all they were good for when we look at the GPT tools like that. Now what's happened is as we've worked with these large language models and they've gotten bigger, where we've incorporated more data, we've trained them longer, and machine learning engineers have noticed a new kind of what they call an emergent behavior that's come about from these models that isn't there at the smaller size of the models. But when these models get really big, they allow this new capability of this in context learning. What in context learning allows you to do is you can give the model a few examples of a type of question and the model will then continue to answer in that question. So an easy example of this is sentiment. Imagine you had to have movies and you had to rate the sentiment. In the old days, if you wanted to do this, you would have to go out and label a bunch of movies. Let's go get 100 or 1,000 movies. We read the reviews, we label the sentiment. Is this a good review? Is this a bad review? Then we train our model to do that. That's traditional data science approach. What we can do with these larger language models is say, hey, here's three examples. Two of these are good movie reviews, one of these is a bad movie review. Now I'm giving you a new movie review. Will you tell me what this movie review is? And the model will reach back with us with the answer. And the key here is we're not changing the weights of the model, we're not training the model in any way just by carefully asking it for some type of information it knows and can kind of figure out, oh, you like it like this? Well, I will give you back an answer in that same kind of format, style, same type of information. And so this for me is just mind blowing. And it also makes us rethink like a lot of the tasks we do in NLP and how many of these we're going to be able to use this paradigm to do it. So that was a long answer. I'll let you see how much of it you digested.

That's a really good answer. So, you know, we all have this new skill that we've been developing, you know, around prompting, especially this past year. Prompt engineering is now a thing, whereas it wasn' very far back. It was. You'd go, what? What's that? So how does this all tie in? We have this new skill about prompting and learning how to prompt effectively to get this information. You're talking about this emergent quality of these large language models. How do those tie in? What does that imply for steps forward and what should people be thinking about to make that productive forum in day to day use?

Let's take this example to like something that you would do practically inside an enterprise, where somebody might give you some type of document or chat transcript which might be a little bit unstructured, and what you want to do is just categorize it so now what we can do with using these prompting and these approaches is we can take that amount of information. I can ask the model, hey, will you structure it? Will you clean this? Will you take out the HTML format text? It'll do that and then I can ask it another prompt. Hey, can you summarize this? Like take this from 100 line conversation just down to the essentials, 20 lines, you can write a prompt for that, then you can ask it, hey, will you categorize this? I need to see, should I send this to my claims department? Does it go to hr? Does it go to it? We can write a prompt for that. And so now what you have developers using is tools like LangChain where they can tie together several of these prompts and create workflows that in the, prior to this we'd have to use separate machine learning models to do each of those tasks. And I think this is really, for me what the mind blowing part of it is, how it can change machine learning and really do a lot of this democratization that we've talked about for a long time, but do it through a natural language interface where somebody can just literally give it these tasks in a human language and then have them accomplished. For the data scientists out there, it's a little mind blowing because I've been in this place where we've tried to teach people citizen data science and we have classes on how to properly partition data and holdouts and loss metrics and all of this. But this approach dramatically kind of changes how the number of tasks people can do kind of without having to learn all those concepts.

That's a great point. With the advent of ChatGPT and some of the others that are out, barred and everything coming out, it has exploded the audience that can productively use this technology. So. And do you see any, any limitations in that going forward or do you think it's going to continue to grow?

And I think this is, to Daniel's point earlier, this is the mind blowing part is I gave you the simple example. Now what you see people doing is taking this, but combining this with other APIs and other services. So in that case of the movie reviews, maybe I want to get the weather forecast or I want to find out if the theater was open that day. Something else, well, now I can use that same type of natural language interface and connect to other APIs, other services and other information. And so this is where we see some of the most powerful applications of this with tools like hugging GPT which allow you to interconnect with lots of different hugging face models where I can ask it a question and give it a picture and the model will automatically go out, figure out the appropriate hugging face models to use, run them, figure out the answer and bring that back to me. Or and this repo has been going crazy as the auto GPT one where we essentially take that. It's not just for models. We allow the large language model to do any task where we can say we, hey, start up a business and raise some money for me and then the model will go out, answer that, go see, hey, is there some other databases? Is there some other APIs I can use it? And we'll continue to iterate. It's going to might cost you a lot on the tokens for GPT4, but they'll continue to iterate and try and try and try and do it. And I think for me, if you asked me a year ago if this was possible, I would have said no way, that's three or four years out. I can kind of see how you're doing it. But to me this is why it's such a special moment. We're living in it because I don't think any of us could have predicted we'd be here, you know, a year ago.

Even in our conversation so far, like we've listed out like a bunch of models. So GPT is and auto GPT and hugging GPT and like bloom, flan, flamingo, 7 billion, whatever in terms of large language models and what's out there right now, One interesting thing is like open access or various patterns around that and hosting. How do you think about the landscape of large language models? What does that look like right now? What are the major categories that we could kind of have in our mind as clusters of these things at this point?

There's tens of large language models and there's a number of different ways we can kind of categorize your thinking about them. One of them is kind of the simplest. Which ones are proprietary, which ones are open source. There's a spectrum when we talk about access to these. So there's some like for example, OpenAI, where you don't have access to the model, you don't know what data it was trained on, you don't know the model architecture, you just send your data to them, they send back the predictions. And so I think that's one model there and then all the way. At the other extreme today, for example, Databricks released the latest version of its Dall E model, which was an open source model that was Then instruction tuned on a data set that databricks created themselves, that they're making available kind of open source for commercial use itself there. So there's the whole spectrum there, but there's other spectrums here too, because the models for example, vary in size. Where you have, for example, something like Bloom that was developed by Hugging Face, which is one of the largest open source models, it's something like 170 billion parameters to some of these much smaller models that are coming out that the Llama models and others that are maybe a billion parameters. And that size has implications in terms of how much reasoning ability, how much stuff is inside there, but inference. Is this something that your teenager is going to run on their own gpu or is this something that's going to take a multi GPU cluster to be able to effectively use? There's other dimensions like what data the models were trained on, for example. With the open source models we know what data they were trained on. One piece of this, for example, that's come up is knowing how much code a model was trained on. Because one of the things that's often asked for is hey, can we build a text to code type model where I want to do some type of auto complete some type of code generation type project. Well, if I start with a large language model that already understands code, it's a lot easier to fine tune it and make that capability. So like understanding the underlying characteristics of that data. DANIEL Right. It's like a Alphabet soup of different names and like literally every week they're popping up and there's so many of these different characteristics because they also differ, for example on the model itself and what's the licensing is and the model weights, the data set that it was trained, the training code that it was done. We see this with kind of how Meta released the Llama model, where they told everybody about it, but then they released the weights, but then they gated the weights so only academic people were getting to them. But then the weights were essentially leaked and now they're all over the Internet. So now everybody's using them. So it becomes very confusing kind of in this big thick mix of you know, how to sort this out.

So you're an organization out in the world today and you're trying to make sense of all of this. And if you just look at, at your last answer alone, it's just like overwhelming for most organizations to look at. There's all these different characteristics. There's big models, small models, open source, close, you name it. There's you can slice it so many different ways. How do you make sense of that? If you are, let's say that you're in management at an organization, not necessarily the data scientist who's 25 and gets the data side, but you're trying to figure out, how do I do this in the larger sense? How do you start making sense of that? How do you know if you need your own model that you're going to create, if you're going to go use somebody else's big, small, what's a good starting point for people to start sorting through the mess that we're all delighting in today?

And it is a mess. And I get calls all the time from model governance folks that are trying to like, we need to set out a blueprint for our company. We need to think through this. Because right now the incredible change of the pace of change and all of that. Right, that's the downside of that. Like, if you're trying to understand what's going on, it's really hard to. And I think a lot of organizations at this point, there's not a lot of easy cases for like, let's implement this because it's going to 10x our revenue for this particular thing. I think there is a lot of breathing room in terms of enterprises and being able to figure out what the best strategy is for the models over the next year or so like that.

I personally really benefited from hugging face tooling around this. So, like some of the decisions that I've made in terms of my own integrations into the applications that I'm building are because I know there's a community around some of these sets of tools. There's sort of interoperability if I want to pull in like this model size or that model size or like whatever it is. And even like these large models, like you mentioned Bloom, there's so much integrated tooling with. I remember a really awesome blog post about running Bloom in Colab using accelerator bits and bytes and these things for quantization and all this and all of that set of tooling from this hugging face ecosystem I think is so powerful for people actually practically trying to do this. I'm wondering. There's so many cool tools coming out as well in that ecosystem and you're of course at the center of it being part of that community and that company. Any highlights that you'd like to highlight? I highlighted the one which is really cool and I'm playing with. But what else should be on our radar?

That's great. I know both of you kind of enjoy the Hugging Face ecosystem and have spoken highly of it before. The Hugging Face ecosystem is all about just helping to create and democratize machine learning. Build out the open source for it. To Chris's earlier point, we have a place where everybody can go and check the models and read what is the licensing for the model, you know, what are the implications for that? And learn about that now when it comes to these large language models, like, we've been busy building out pieces on that. So if you think about kind of training these large language models, Nathan on our team has written some blog posts around using techniques like reinforcement learning with human feedback. That's the latest cutting edge approaches to figuring out, like how to get these models to align exactly with what humans do. Because yes, we can feed a bunch of data into the models, but what comes out of them often isn't what you and I would think is the best. And so this using reinforcement learning with human feedback does that. I think one of the things I'm excited about is the PEFT library that we have, which is parameter efficient fine tuning. And if you look at these models, they're huge. They take a ton of resources to do. PEFT has a number of different approaches in there is how can we fine tune these models without having to load the entire model and modify every weight in this? And there's a number of different techniques. For example, just, hey, can we take the entire model weights and find a smaller structure inside them, like a low rank approximation? I can't think of that name. Can we get then that little dense piece and just train that part and add that onto it. And if we do that, that actually works as a fine tuning technique without having to train the entire model. So I think this is where the Hugging Face team is busy building out a lot of infrastructure and tooling so we can kind of all effectively use these large language models.

It reminds me that tooling is tactical in terms of solving problems. And for Daniel and me, given the podcast name, tactical is practical.

Wow, that's good. Maybe we should redo our tagline there, Chris. I'd have to run it through ChatGPT first to make sure it was good. But we always talk, or we've talked many times on the podcast about how a lot of times the practical side of AI is on the inference side, not as much on the training side potentially because like 99% of what you're going to run your model in production is inference. I'm wondering, like, with these large language models, I can see like various scenarios Happening, right. A lot of people are just putting that thin UI on top of OpenAI and they're never training anything and they're using that in context learning. But now with the tooling that you just talked about, there's sort of this ability to fine tune these large models in a way that wouldn't require you to have a bunch of racks of GPUs, right? But maybe you could even do it in like some hosted system like a colab or something like that. How do you think that shifts people's approach to how they're solving problems over the long run? Because it was sort of like for a while everybody's training their scikit Learn model. And then it seemed like for a while, okay, now I'm just going to use APIs because I can't train these models. And now we're kind of coming back to this, okay, well what about fine tuning, parameter efficient, like we're not loading the whole model in. How do you think that changes things moving forward?

As somebody who's worked inside enterprises for a long time, I knew the infatuation with OpenAI's APIs were only going to last so long because like I've tried to sell data scientists a black box solution. You don't get very far, right? Like if it's inside your enterprise and your reputation, your job is on the line to make sure that model works. You want full control over it. Not to mention enterprises want full control kind of over their data that's going into the model and how it's being used. You know, you're going to see. And this is where there's been so much energy is in this development of open source large language models. But I mean, what's blown me away in the last few months is just how widespread this community is because I think, you know, some of the developments you've seen are around C interfaces for large language models, right? Things that no data scientist I know would be able to develop something like that. But because there was so much excitement, we got other folks, typical software developers engaged in building tools. And I think there's a lot of focus right now on building these types of tools for this efficient type of use of large language models, because nobody wants to have a cluster of GPUs like that. Microsoft, in fact, just today released their DeepSpeed chat tooling to help people train models using less infrastructure, right? Being able to do it faster. So I think there's going to be tremendous development of tools because at the end of the day, most people would like to have a model that they can fit inside their computer or, or a couple of GPUs, something that doesn't take a lot, that they can control, that they can tune. And so I think we'll see a lot of development in progress in terms of open source pieces for that.

Well, Raj, I am curious to know how many of your conversations these days around AI models and large language models are about some of that tooling and practical stuff that we just talked about. And how many are around sort of like ethical concerns or hallucinations or environmental concerns? What does that look like in your life right now?

So that of course is a huge part because again, this is like the difference between traditional machine learning where we often thought about bias in models, right? Like is your model going to work for kind of a young generation versus an older generation like that. But now with large language models and the ability of generative models, right, they're creating information like how accurate it is. One of the common fallacies we see, and hopefully most of the listeners here are quite aware of that, that these models lie. They're just going to create output and the output doesn't necessarily have necessarily a tie to reality with that. So this is one of the biggest education pieces that we have to do is because people see OpenAI, they see the other tools and they're used to just typing in a question and getting back an answer. But to really use this in like in let's say an enterprise setting, you know, this is, I always suggest to people to pair this with traditional information retrieval techniques. Like we already know good ways of having to search and pull information. Let's use those ways that are factually based and then we can still layer on top a large language model to give you that nice chatty type interface. The large language models are great at writing like that and take advantage of both. But yeah, there's a tremendous amount of like education that has to be done around, for example, hallucinations. You know, that's just the tip of it. There's also, right, like what's the training data that was used for these models? Right, like, where did that come from? And then once you use these models and you get output from these models and this is where customers, especially for some of the code generation ones and image generations are worried about, is they're worried about their own legal consequences of using these models that, that might have some type of, you know, leakage from the training data and copywritten material that could be in the outputs. It's a lot of different issues going.

On I've had conversations with people in various companies over things like the OpenAI licensing model since they're using ChatGPT and and it's really made people aware that you can be giving over IP for using and that's just one of many possible concerns. I wanted to throw something and I know you've been asked this a whole bunch of times because it's a really big topic. I'd love to hear your take on it given where we're at right now with large language models and some of the variants that we've talked about here. Where does this sit in the concept of education? You have the gamut being run from. You're not allowed to use any of these models for your coursework. And then on the other side, and I think I may have mentioned this to Daniel a few weeks ago, I have a 10 year old daughter, actually 11 year old in fifth grade and she had an assignment and I actually started us off going and doing some stuff in chat. GPT ended up having her do her own work but I actually incorporated it in. But I've also talked to people who are deathly afraid of it skewing academia and how you're measuring students progress. What might be a reasonable path forward in terms of trying to integrate this new technology into schooling.

I'm very pragmatic and know that we just have to kind of accept it and adopt it.

Me too.

Now I agree that there's going to be short term issues to figure out who has access to the technology, making sure everybody right? Because this is an easy way for people who have access to those resources versus don't to further differentiate themselves and kind of even increase the differences between groups even more like that. But I'm very pragmatic like this. Like I think it's a very helpful tool, it's very useful and it's going to be a part of how we work. It's not only on the education of like students in terms of young people. I also think we also need to get our co workers on board too because I think a lot of us probably listeners are early adopters that like playing with this. But I spent time teaching my sales team how to use the tools like Claude is built into Slack. I'm like hey, look at what you can do with this because I think it's one of those things that can enable a lot of people but it takes a little bit of education, a little bit of pushing to get people who aren't kind of used to these tools adopted and especially not Only the good that can come, but also like we talked about earlier, the hallucinations and so that they properly kind of use these tools as well.

Also I think it's the web developer, other developer community that's starting to enter this space. Like you were talking about, like with the C stuff or other things, there's other people contributing, which I think is great. You have a wider set of views being brought to the table around how these things should behave, how we should use them. Like there's a lot of, there's a lot more people at the table and I know one of the things I've seen, of course, a ton of that startup energy to like people building things on top of this, you know, some very quickly, like I say, that's just a thin landing page on top of OpenAI. But others that are like really fascinating and interesting use cases for this technology. Of course, a lot of that community as well overlaps with the community using hugging face tooling and those you're hugging face is interacting with. What is it like for you to see that energy around startups? And there's so many things coming out. I know startups are already like low percentage chance of success, but a lot of these things are really amazing and I think could reshape like how we work, how we learn. Like you're talking about Chris and other things. So what are you thinking around that front end, like also having a sort of front row seat to see a lot of these things like being released.

It's an amazing time like that. And I love seeing the startups because people are experimenting, trying new ideas, trying new things. Right. Like most of them will undoubtedly fail. But I think in the meantime we're going to get a lot of good ideas for different ways and approaches that we can kind of use these tools. And that, that right there has me very excited about that.

You know, one of the things that I've been really having some interesting conversations is, are about people who are not us, not in our audience, people who are in the larger world and really, you know, may have loosely followed, you know, kind of what's happening in the AI space and kind of in the mainstream media. But they're struggling to really understand what's happening right now. And you know, we kind of started the show off on that whole premise is that there's so much happening right now to the point of I was at a dinner function recently, it was just a couple of weeks ago and I met this really cool dude who was in his mid-80s, but really sharp follow Technology. And we started talking about AI and he's just like, I'm trying to track it and understand. And one of the points, I turned to him with the idea that we're having these large language models that are now penetrating into everyone's consciousness. I said, this is that moment where you're going to look back and realize this is where you were conscious of AI being a part of your life. And it will take off from this point forward. When you're talking to people about these issues. How do you adjust people who are not used to this stuff the way we are? How do you get them into the right way of thinking about it in a productive way and kind of onboard them? Because it's not the same conversation today as it was a year ago. As you said, it's changed. So how do you approach tackling that?

I think one of the easier ways is if I can get them to use the technology, if they can use an image generation where they can type in something and see the differences in results that might get. Or use a ChatGPT, where I can kind of coach them and do that. Because you're right. Like trying to explain exactly what this does without the context of actually using it. It's like telling somebody about something in the future that it's hard to kind of contextualize and understand what's going on. The easiest answer for me is just like getting them using it a little bit and then that helps to. Then showing them then, like, what are the boundaries? What are the limitations? Like, what can we do? What are the possibilities once they have a grounding on that as kind of.

A follow on to that? We've kind of acknowledged we're in this sort of historical moment. And in years past on this show and last time you came on stuff, we might have talked about kind of historical moments in the context of AI, But I think we're all agreeing that it's becoming a historical moment for the whole world, whether you're in AI or outside of AI because it's impacting everybody. You also acknowledged along the way that there are kind of ebbs and flows, you know, that we have. We're certainly at one of those moments of just intense new stuff coming out. What do you see in the future, both short term and long term? Where do you think we're going from here? Because it feels like we're in an Alice through the Looking Glass kind of moment. So what might the future look like? And what are you guys anticipating at? Hugging face?

So I agree, right. This is just an amazing moment. And I think it's more so for the people that are in it that understand AI and what's going on and kind of where the steps we've made over the last year, you know, and where we can go going forward. I still think we still have to figure out when we're talking about kind of larger humanity and the larger group of people, exactly what is the impact and how we're going to use this? Because, yes, we have chatbots, but most of us didn't spend a lot of our life before using chatbots.

Right.

Like, I don't know how much of our lives, you know, going forward, we'll have to do that. So we'll have to see how that's integrated. But I think, you know, all of this just shows us that the idea of AI, the idea of having using machines to help us make better decisions, is something that is becoming much more widespread. We're really kind of on a path with Hugging Face to help democratize that, bring that barrier down, allow more people. So not just the people who have been trained for four years in statistics and went and got a PhD, but somebody that can think through a problem a little bit, go interface back and forth with a computer, can all of a sudden build code or solve a problem by tying some prompts together and really allowing lots more people to harness the collective AI, the collective information that we have, and allow for more productive uses like that.

Gotcha. Good answer. As you know, Daniel and I have been longtime fanboys of Hugging Face. We think it's a fantastic community, amazing tooling. So as we close out, you want to point some folks to maybe a few things that Hugging Face has to offer that might be good ways of ramping up in different areas. Just kind of call them out.

Absolutely. So the Hugging Face website has. Is a great place to start. There's a free online course that you can start with using Transformers there. There's forums, there's Discord. There's a community there. Feel free to kind of jump in and kind of get engaged there. And then we're building out lots of pieces. You'll see more models coming up over the next few months, that we're going to be releasing more tooling for working with this. So, yeah, there's a lot going on.

Fantastic. Well, thank you very much for coming back on the show. You're always exciting. You're fantastic at representing Hugging Face and sharing your perspective with everyone. And we'll have to do it again sometime soon. Thanks a lot, man.

Absolutely. Thank you for having me. I enjoy this.

Thank you for listening to Practical AI. Your next step is to subscribe now, if you haven't already, and if you're a longtime listener of the show. Help us reach more people by sharing Practical AI with your friends and colleagues. Thanks once again to Fastly and Fly for partnering with us to bring you all Changelog podcasts. Check out what they're up to@fastly.com and fly IO. And to our Beat Freakin residents, Breakmaster Cylinder, for continuously cranking out the best beats in the biz. That's all for now. We'll talk to you again next time.