Should kids still learn to code?

Foreign.

Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI related tech is changing the world, this is the show for you. Thank you to our partners at Fly IO, the home of changelog.com Fly transforms containers into micro VMs that run on their hardware in 30 plus regions on six continents so you can launch your app near your users. Learn more@fly IO.

Welcome to another fully connected episode of the Practical AI Podcast. This is the episode in which Chris and I keep you fully connected with everything that's happening in the AI world. We'll hopefully talk through some of the news and also keep you up to date with some of the latest learning materials. I'm Daniel Whitenack. I am CEO and founder at Prediction Guard. I'm joined as always by my co host Chris Benson, who is a principal AI research engineer at Lockheed Martin. How you doing Chris?

Doing well today, Daniel. How's it going?

Oh, it's going great. We, my wife and I have been traveling a bit around the UK which has been enjoyable other than the train delays and rain and wetness is actually we, I think today we saw all of the above of sunshine, rain, hail, snow, the full, the full gamut of things.

It's amazing how you can have so much weather in one little island.

Exactly, exactly. Variety.

Go a few miles and it changes.

Yeah, yeah. Variety. Well, there've definitely been a good variety also of interesting AI things happening, as there always are. One of the things that was kind of interesting to me which was circulating around my feeds was Nvidia generally because they had their gtc. I always want to say gtx, but I think that's the card GTC event which is their kind of innovation, a yearly conference sort of thing. But Jensen, the CEO was making some comments. I don't know if it was actually at the event or in another venue, but making some comments about kids learning to code. And his comment was related to. I forget how he phrased it, but basically the gist being kids shouldn't learn to code anymore because AI is going to do that fairly well. So I don't know, I don't have kids, Chris, but what is your thought as. As a parent, as the designated father? Yes, exactly.

On this podcast. Well, I think he's right in the long run. I think he mentioned that in the keynote there was a little section where he covered that and he said always in the past we've taught our kids they need to code, you know, in recent years. And he said now AI is changing all that. And I don't think that's news to anybody in the larger sense. You know, we use AI for coding and technical controls and all sorts of stuff all the time. And that's just built into our ecosystem over the last few years and is increasing constantly. I have to admit that he was kind of like, we're at the moment, you know, it's. And I'm not quoting him, but, you know, he was kind of like this the moment we're not teaching them anymore. And I'm kind of like maybe, maybe. Because I know that even with. With us as adopters of AI technology, you know, for coding all the time, I mean, if there's anything that we do, it's. It has to do with that. And there's all sorts of complexities and bumps in the road and things like that. So in the large, is it moving that way? Of course, I think everybody would agree with that, but I don't think that we've all just arrived there because Jensen just said it in a keynote. Personally, I have great respect. I don't mean to be negative. And I just like. It was like flipping a light switch kind of the way you put it. And I don't think we. I think it's a very, very slow flip with lots of nuance.

I guess one way to rephrase the question would be at this moment, were you to have a child going into college, let's say, would you encourage them to pursue software engineering or computer science or this sort of thing?

I would. I think that in the future. And actually I've spent a lot of time thinking about this topic in general, hundreds and hundreds of hours. And this is one of those things where I think we're accelerating into the future. And I think with AI capabilities year by year making massive changes to how we live and work, humans are going to have to be fairly dynamic in how they do things. And one of those skills continues to be various technology orientations. And I don't think that's going away anytime soon, though AI will continue to change where those boundaries are. So in the spirit of. We're always going to have to learn new things anyway, I don't see any problem in diving into technology and coding today with the recognition that the technology will constantly change underfoot and you're going to have to change with it. So I. I don't think I would recommend. And actually I do for Georgia State University. I. I'm one of their advisors in industry for their computer science school, and I would not dissuade any of Those students from pursuing a computer science curriculum at this time, they just need to be dynamic enough to change over the years.

Yeah. And maybe part of it is also these tasks that like if you go to a three week boot camp on front end engineering or something like that, probably many of the things that you would learn in such a boot camp, even though I think there will be a need for front end engineers for some time also. I think that's true. But that sort of basic level that you would get is maybe at the level where it's going to be more and more cookie cutter sort of things that an AI system is going to be able to do with guided by the hand of maybe a less technical person, like a designer rather than a front end engineer.

Right.

But I run an AI company and we really need software engineering and programming. So I think at the minimum, all of these AI systems that are coming about are going to need people to build them and maintain them and infrastructure that operates well and scales systems are still going to have to scale and people are going to have to worry about distributed systems and all of these sorts of things that are really hard engineering problems. From my perspective.

I agree the human algorithm partnership is going to go a long way for many years, but it will change all the time. But that's not limited to our fields here. This is something that all industries are going to be facing is that constant change on what the partnership looks like. So I'm not inclined if unless somebody sees an area where AI is in the next, you know, very few years going to completely take over all human activities in it, I don't see any reason to avoid these things. I think we're in a perpetual learning mode going forward.

Yeah, I've actually been thinking about this sort of dynamic a little bit after we've had a couple guests on the show that are working on these systems like prompt layer and other ones where they're managing prompts and reasoning workflows at the intersection of domain experts and software engineers. So the technical side kind of where software meets domain expertise. I was on a panel at Purdue University speaking of students and that sort of thing. And one of the questions was around this, you know, well, hey, I went into this program thinking maybe I would try to become a data scientist. Is that still a thing or should I be thinking about something else? I think one encouraging thing for people is if you're a data person, no one really has more than a year of experience architecting and building these type of generative AI systems. So in a sense you could do one really compelling project and be ahead of most of the people trying to get these jobs right. So in one respect that's really encouraging. I think it is shifting though, what a data scientist means, and this coming from a data scientist that has been a data scientist for 10 plus years. I think there is this kind of hollowing out of the middle where you had the three things where on one side you had software engineering and infrastructure and that was the land of sort of software engineers and DevOps and all that. And on the other side you had domain experts, and in the middle you had data scientists who kind of translated the domain expertise into predictive models and machine learning and such that then got handed off on the other side to integrate into software. And I think what you see is kind of this hollowing out of that middle where domain experts are getting much closer to the software side. And so I think there's kind of two maybe takeaways from that, from my perspective. Either you could go into the AI engineering side, which is maybe less hardcore infrastructure, low level programming and more almost narrative writing of prompts and creating of these reasoning chains and all of that sort of thing, and become amazingly good at that and rely on good software and infrastructure people on the other side, or there's still going to be a need because everything is still software. There's still going to be a really heavy need for people that can make your chains of reasoning and hosted models and software deployments actually go well.

Right, Totally agree. And you said one thing in there as well that really, really resonated with me. You said several things that did, but one thing that jumped out that I'd like to reiterate is the notion that if you do that one big project, you're really out in front again. It's one of those things where because it changes so fast right now from month to month that it doesn't take much to do the new thing that's just coming out. And the people that might have had many years of experience in the title haven't had experience in this new thing. And that keeps on happening. And so the notion of being a title, whatever your title is for X number of years, is really losing a lot of meaning in that and that you might have been in the space, but with the space increasingly evolving, you can kind of catch up into modern experience pretty quick. So people are very worried about jobs in this space. But that's a, that's a little bit of a way where you can be super competitive and jump up in the area of your interest by leaping into the front and disregarding the traditional metrics that we tend to use on that.

If you're anything like me, you have a certain tendency to put things off until the very last minute. Seeing the dentist, going to the doctor, home improvements, that never ending chore list of yours. And while most of the time it works out just fine, the one thing in life that you really cannot afford to wait on is setting up term coverage life insurance. You've probably seen life insurance commercials on TV and thought, yeah, I'll look into that later. No, later doesn't come. This really isn't something you can wait on. Choose life insurance through Ladder Today. Here's what we love about Ladder and why we allow them as a sponsor. They are 100% digital. No doctors, no needles, no paperwork. When you apply for $3 million in coverage or less, just answer a few questions about your health in an application. Ladder's customers rate them 4.8 out of 5 stars on Trustpilot and they made Forbes Best Life Insurance 2021 list. You just need a few minutes and a phone or laptop to apply. Ladder's smart algorithm works in real time, so you'll find out if you're instantly approved. No hidden fees. You can cancel anytime. Get a full refund if you change your mind in the first 30 days. Ladder policies are issued by insurers with long proven histories of paying claims. They're rated A and A plus by AM Best. Finally, since life insurance costs more as you age now, yeah, right now, now's the time to cross it off your list. So go to ladderlife.compracticalai today to see if you're instantly approved. Again, that's ladder.com/practical AI l a d d e r life.compracticalai.

Well Chris, as people are diving into to their first projects and areas of interest and new things in the field, one of the interesting things and kind of learning resources that we don't maybe spend a ton of time talking about, although we are actively engaged in it, is community around the AI space and where people can connect with that sort of community. We've produced a lot of content, but we've also engaged in various spheres over the years and there might be a lot of new people. Let's say they're web developers or they're backend engineers or whatever and they're getting into this space, they're doing projects and their kind of normal programming conference isn't or maybe has some AI topics. But they're wondering is there a better place to find People that are doing these sorts of projects and, and that sort of thing. I know you were at one point involved in kind of the meetup space, although Covid maybe had a little bit to do with the downgrade of some of those communities.

Yeah, it's a great point. And it's evolved in interesting ways. Kind of what you're getting at there. And to start with the last thing that you said, I was for a number of years I ran the Atlanta Deep Learning meetup. And the phrase deep learning is kind of antiquated now as well, and the learning. And it kind of fell off when Covid hit. But we were really the preeminent kind of AI oriented community in the Atlanta area, which is where I'm at. It's interesting as another counterpoint to go into this. You and I met in a different community. We met in the GO language community because we were both GO programmers and we were kind of the two people thinking a lot about AI and data science in that community. So it was a natural thing for us to gravitate together. But interestingly, if you're really focused on different aspects of AI, whether it be generative AI or other fields of AI, since we've recently pointed out that not all things are just generative AI, even though that's the hot thing right now, there are many vendor specific communities. We have a podcast specific community here where we engage our listeners all the time and there are some platform specific communities. But there was kind of a, like where we met in the GO community, there was an overall whether whatever you were doing in the GO space, there was a larger community and you kind of knew all the people and all the names that were there and would follow that and be participant in it. Here we don't really have that. We have many, many fragmented AI communities and we'll go to hugging face for, you know, to get open source models and to see what's going on there. And you know, there are lots of these smaller communities. But I would imagine if you're coming into the space today and you're one of those people who really want to dive into AI here in 2024, it must be very hard to figure out what space you should be in to make all the connections and to ramp up. Any thoughts on that? What you. What would you recommend to somebody, Daniel, if somebody were to. To come into the space today?

Yeah, I. It is a bit of a challenge because it is a bit fragmented and maybe we could split this up into a couple of kinds of engagement. Maybe one from a More technical side and one from a less technical side. So in terms of architecting and building generative AI apps or other kind of AI apps or fine tuning models and that sort of thing, I think what I would generally recommend is starting out with some sort of learning resource that is probably, probably going to be on Hugging Face LangChain, Llama Index, Lance db, one of the other vector database providers. These sorts of projects have really good tutorials and guides associated with them. Starting out more project related, like those are, you know, trusted projects in the AI space and trusted platforms in the AI space. And then looking at one of those projects, like let's say you go and you find a guide that is, you know, setting up multimodal rag system to search over videos or images with Llama Index or something like that, right? Well, a lot of these projects, not all of them, but a lot of them have some type of forum or chat kind of interface that the community around those projects gathers in. So oftentimes it's either Discord or Slack or a forum type of thing. So I think if you start kind of in those spaces like a Llama Index or Lance DB and look at a guide that is something similar to what you want to build, you try going through the guide, but you also look to see if those projects have a Discord associated with them or a Slack channel associated with them and go ahead and log into those and you know, it's okay to lurk for a while, but as you're going through your example and you know you don't understand this or you're getting that error, just go ahead and be brave and put something in those spaces. I've generally found them to be fairly welcoming. For example, if you go to Llama Index, there's a community page and you'll see right away join Discord. There's many other of these spaces. So like our friends over at the Latent Space Podcast have a very, very active Discord server that they're running. We have a Slack channel associated with this podcast, but there's other projects like Lance DB has a Discord channel. And these are generally people that are building projects within this sort of space, within this sort of topic. And they're generally open to, hey, I might not only be using Llama Index, but I could ask a question about choices of vector databases or choices of models. And everyone in there is kind of working in this space and may have biased or opinionated thoughts on that, but you gradually kind of learn and meet people in that way. So I think it's in some ways it's a little bit more project related than kind of overall community related. And Hugging Face is a great community in the sense of GitHub being a community, but it's not where people are having all of these different conversations about specific projects and guides and that sort of thing. They're collaborating on models and data sets and that sort of thing, but maybe not in a kind of asynchronous chat sort of way.

So what do you think about the social element? Because, because we. There's some great guidance there on learning and kind of connecting on a project basis and stuff. But where would you go for the personalities, you know, for the friendships that you develop? How would you approach that?

Daniel yeah, it might depend on people's personality and what opportunities kind of present themselves to those people. There are a good number of events that are gradually happening. Like our friends over at the mlops community have had a series of online virtual events. I know there was a AI engineering event out on the west coast. There are events like Hugging Face, I think is doing some type of hugging face tour with demos at various locations in person. So that's a really great place to kind of meet face to face with people and interact and build relationships in terms of personalities and that sort of thing. One thing you could do is look at our previous episodes of this podcast and go. And even if you don't look, listen to all the episodes, which of course you should because they're all great or maybe some are better than others, but they're, they're all pretty good, I think. But, but you could look at the guests from the previous podcast and go to LinkedIn, go to Twitter, go to Blue sky, whatever your favorite social is, and see if you can find some of those people on those platforms. And those are trusted people that, you know, we've met over the years. And so in an online sense, you could start following them and see who they are kind of reposting and interacting with online. And that's kind of how your web of connections can form a little bit.

So I want to turn from the community questions that we were just talking about and spread it out. The community notion that we were just discussing was really focused on those of us who are embedded in AI work. We probably do it for a living. This is kind of very central to us. But there is most of the world out there that does not fall into that category. And yet AI is still impacting their lives in tremendous ways increasingly. And one of the things that I have been keenly interested in lately is for the rest of the 99% out there that are not building their professional lives on AI in every moment the way we are, they still need some entrances into how to use this in a productive way. We are getting on the podcast and with our audience and the listeners talking about Gemini and ChatGPT all the time. And there are these other 99% they're hearing this too in the news, but they don't really understand it. They're probably not using it. They might have tested out one of the free interfaces here or there to see what it was like, but it's not part of their workflow. Right now we're seeing a period in 2024 where organizations are starting to explore and even demand that their employees start using these tools. They're making them available, but they're really struggling with adoption. I've run across all sorts of issues where hitting mainstream adoption with generative AI tools has been a tremendous challenge. And so I'd like to dive into that for a couple of moments and kind of talk it over where we're going because that's certainly I know the organization I'm part of is interested in this topic and I talk to people every day that are trying to figure out how do we get it out there beyond our software developers and our data scientists. What are your any thoughts you have there in terms of if you have your typical non technical worker, they're a knowledge worker and they have a set of tasks every day, how do you start to break that nut in terms of getting those people recognizing where some of these generative AI tools can help them do their own? I have a couple of examples I'll go to in a moment, but I'm curious what you've seen out there.

Daniel yeah, I think there's one side of it which is maybe places for those people to start, but also an interesting piece of this is a mechanism for how that knowledge trickles into an organization, which I think is an interesting topic in and of itself. One pattern that I've seen a little bit at organizations is maybe a couple of champions that are higher up on the ladder that see the vision of transformation and see that this is going to be a transformative technology for their organization. And those leaders might take some type of courses or certification or crash course type of thing in the topic. So MIT has some kind of AI for digital transformation or AI generative AI related things for non technical people that they offer online and I think maybe some even live Nvidia has some courses like what is Generative AI? Generative AI explained Nvidia has some of those types of things. So there might be these leaders who see the vision for how this is going to be a transformative technology. They might do one of those things to understand at a level that makes them comfortable. And I think part of the trickle down is leading by example in that so when they're having interactions with their team and or other teams, I think it can literally be, you know, something comes up in a meeting and you're sharing your screen and you literally, you just have a tab open that is Chat GPT or Claude or Gemini or whatever and you go over there and you literally just, you answer a question or you get something done immediately because you know how to interact with those tools to do something quickly. And that can be a light bulb moment for other people where they see a person leading by example using a tool and not like, here's how you use this tool sort of way, but really in the flow of how they're doing their own work. And I think that seeps through that's really impactful because it shows, oh, this person who is maybe influential in my organization is operating in this way and able to do these cool things with these tools. Can I, you know, do that? I think some of it can also be a little bit directed where you're having your one on ones maybe with your direct reports, right. And they're asking questions that they should be able to source the answer to or accomplish very quickly with these tools and you can tell them, hey, you know, there's, there's a pretty quick way that you can get this summary or develop this outline for your presentation out of this article. Let me show you how to do that and actually have them go to the site, generate the outline for the presentation based on some article or something and actually do that in your one on ones. Even to the point of encouraging people like, hey, you should maybe just have this bookmarked or have it up on your tab. So I think that's kind of how some of that trickle down could happen. And how I've seen it happening is kind of a foothold in these influential people within an organization. And then leading by example and kind of in a one on one sort of way rather than a top down directive of we shall now do things this way.

Right, understood. I actually have an example to illustrate one of the things that you were talking about there. In my own employment, we have both access to ChatGPT and we also host internal models, internal open source models which we love because that way you don't have to worry about the, if you're sending proprietary information out, things like that. And so this morning in my day job, I was working with a team of people. There's a presentation that has to come out of that, a PowerPoint presentation that has to come out as one of the deliverables of that. And as we were having a group discussion, Sharing Screen was able to type in some of the things that we wanted to talk about into the model generated dynamically. While we were on a group call, I generated a set of talking points to the various issues that we were addressing. Basically kind of a presentation within the prompts, if you will, was then able to turn that presentation into VBA code, Visual Basic for Applications code, where it embedded the content in that VBA code. Then I was able to open up PowerPoint right there, copy and paste out of the prompt. This is totally non technical what we're talking about here. Go to the Tools tab, down to macros and open the Visual Basic Editor in PowerPoint which is available to everybody. Pasted in the code as a new module and ran it and it produced our PowerPoint for our team right there. The whole thing took five minutes to get a 30 page PowerPoint set up. Now there was a lot of manual tweaking to be done afterwards and adding some graphics and stuff like that. But we probably cut, you know, five, eight hours worth of work out of our workflow by tossing the critical ideas into the prompt, turning them into that code and copying and pasting. It doesn't take a developer to do that, that anybody could do that. So that's one of many possible use cases where you're, you're using it, you haven't replaced any of the workers, but you're accelerating everybody's productivity dramatically at that point and saving a lot of time to do it. So as I've been thinking about how we, how we get more people in the world to use these technologies to their benefit. I think having a number of different kind of typical Persona, you know, use cases like that that many people might need. So there, you know, there's your PowerPoint strategy folks is, you know, right now in whatever job you're in, you can do that if you have access to one of these larger models. And then the other thing I wanted to dive into is, was it's interesting the emotional quirks. People are worried about everything from will this take my job if I start using it and make me irrelevant. They wonder who's watching when I do this. Can my boss see if I stumble if I'm struggling with something? Who in my company is aware of what I'm doing? So there's a kind of, a lot of fud, fear, uncertainty, doubt associated with the use of the tools. And I think part of that is just kind of in these trainings that you were alluding to earlier to be able to, to have discussions with people about their fears and see if you can get some interest and uptake by going right at the thing that's holding them back. And a lot of times people think it's technical, it's not the PowerPoint thing. You can have zero technical training and go do that if you just know to open up that single thing in the PowerPoint deck and type in the. And not type in, but copy and paste the code that was produced at the prompt. So I think that there are hundreds or thousands of opportunities along this line that people could take advantage of. Any thoughts on what you might do in that way?

It's interesting that you bring up the fear and uncertainty piece because there, there are a lot of misconceptions and it doesn't often work to just straight up invalidate those. So somehow I think if you're thinking about this adoption in your organization and you're working with people to some degree, you kind of have to find an entry point where there's less of this fear and uncertainty. Because I think all of us that are working with these models and have been working with these models recognize that working with generative AI models, prompting them, integrating them into your workflow, it isn't often what you expect it to be, getting into it. And you kind of have to build up your own intuition of oh, this is kind of how this model behaves and this is kind of how this model behaves and this is kind of how the prompting works. And oh, this, you kind of have to build up some of that intuition before you get a sense of how they operate. But you're never going to build up that intuition if you just focus on the use case that people have some fear over, like generating, putting in customer information into, into the interface or something like that. So I think to some degree you have to find some use cases where people are able to safely interact with these models. And it could be private chat interface that you allow people to use. It could be a local chat interface like LM Studio or something like that that you encourage people to use because it's local and there's nothing going anywhere. And you can tell people, oh yeah, this is Fine. And then they get a sense of the models and you can go from there. So I think it's about finding that foothold to some degree. One of the interesting things that I've found is people sort of expect these models. They get disillusioned when they ask like a search engine like question into these models and they just don't find what they need. And so that's kind of some of that intuition that I was talking about. Like these models operate slightly different than a search engine.

That's a great point.

And so everyone kind of had to build up a little bit of intuition I think when they learned about, you know, how to Google things. I think there is a, like there is a skill of how to Google things, right?

There is.

And so there is a similar intuition. I still, you know, I'm sure you've run into this many times. Like people ask questions in a business context and you're like, why didn't you just Google that? Well, maybe they don't have the intuition around how to like properly. I've definitely seen this before. Properly search the Internet to find answers and self serve themselves. Actually it's interesting, I found an article this week that talked about why AI search engines really can't kill Google. This was from the Verge publication. And so it talks about search engines like perplexity and you.com and google gemini and chatgpt. To some degree it goes through, it's really interesting article. People should look it up and we'll include it in our show notes. But it talks through some of the kind of main use cases that you might have learned to do in Google like navigation or something. Navigation questions that don't really work so well in chat and in the current chat interfaces. So there's a different sort of intuition that needs to be built up and one isn't just a drop in replacement for the other.

That's a great point. And there's not only are they distinct skill sets but there is a superset of how you use them together, you know, for their strengths along the way. And you know, with the notion that, you know, like search engines, primary job, you know, as the article notes, there is to get you to a website. And when I talk like I'm still old school and I tend to, I don't just go to a website that I already know through Google, I will actually just type it in directly because I know it and but my daughter who is 11, she knows the website, she knows where it's at, but she still puts it in Google to go there and her friends do that too. She, she uses it as a navigation tool to the point that you just made a moment ago. Whereas when we're prompting, you know, in these models we're really seeking information in a lot of ways, you know, whereas the, instead of getting to a website that has information, we're kind of getting the model to feed that information to us directly. And I personally tend to use both. It's very common for me to flip back and forth between Google and a large language model and use them each for what I want. Or if I don't know exactly where to go for Google, I'll learn a bit from the model and then I'll do a deep dive on a website that's specific to what I just learned from the model and get there that way. So it's an evolving landscape of tools to get these things done now.

Yeah, and I, I would definitely encourage people to check out this article. It's quite interesting. They go through different types of queries, like navigational queries, what they call buried information queries, exploration queries, evergreen information, like how many weeks in a year, when is Mother's Day? Real time queries, like sports scores and that sort of thing. The exploration questions that I mentioned, like why were chainsaws invented? This exploration and learning sort of thing and they compare some of the answers from different ones. So if you're struggling maybe with this intuition, maybe that's a good place to jump in and, and try some of those queries yourself that are there and see what comes back from the various ChatGPT or Gemini or you.com and those sorts of things.

And then circling back on our community idea before try those things, hop into our community here at the Changelog and share what you've done with that. We're very curious to see what people choose to do coming out of these discussions that we've had today. I'm looking for the most creative ideas to inspire me myself. So please send what you got.

Sounds great, Chris. Well, it's been fun exploring this topic with you and look forward to many further exploration questions in the future. Hope you have a great evening.

You too. Take care, Daniel.

All right, that is Practical AI for this week. Subscribe now if you haven't already. Head to PracticalAI FM for all the ways and join our free Slack team where you can hang out with Daniel, Chris and the entire Changelog community. Sign up today at PracticalAI FM Community. Thanks again to our partners at Fly IO, to our beat freaking Residents Breakmaster Cylinder, and to you for listening. We appreciate you spending time with us. That's all for now. We'll talk to you again next time.