[DataFramed AI Series #3] GPT and Generative AI for Data Teams
Sarah Schlobham, Head of AI at Kubrick Group, discusses how ChatGPT and large language models are changing data work. She covers use cases from code generation to report drafting, explains that the most valuable skills are asking good questions and evaluating AI output, and argues AI will automate repetitive tasks rather than eliminate jobs.
Hi, I'm Maggie, VP of Curriculum at datacamp. And I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy executives to cutting edge generative AI for developers, and everything in between. Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power your data and AI transformation journey on datacamp.com.
I think the only thing that we can guarantee about this industry is that it's going to keep changing and it's going to keep adapting and we're going to keep building on what we're doing. It's going to be more interesting, more powerful, and that's going to use different skills. Right, and are we going to be using Python in 20 years? Probably not. I mean, some people are still using Fortran, but hey, for the most part, no. There are trends, there are shifts in what we do. This is a big one. This is a big step change.
Welcome to part three of the Data Framed AI series.
This is Richie.
Generative AI is already having a big impact on data teams. So it's important to understand how to use it well and to understand how it's changing the careers of data analysts and data scientists. Helping us keep up to date with what to do is Sarah Schlobham, the head of AI at Kubrick Group. At Kubrick, Dr. Schlobom leads the training for the next generation of machine learning engineers. With a background in finance and consulting, Sarah has a deep understanding of the intersection between business strategy, data science and AI. In addition to her data science and AI work, Sarah is also a chartered accountant and has a PhD in particle physics. In today's episode, we'll cover the impact of generative AI on data teams and on data upskilling and careers. Let's hear what Sarah has to say.
Hi, Sarah, thank you for joining us on the show. Great to have you here.
Hi, Richie. Happy to be here.
Brilliant. And I'd like to just dive straight in, talking about what are the use cases for generative AI, particularly for people who are working with data?
Yeah, absolutely. I mean, I think the thing I'm actually really excited about it is for how many cases there are for not data. I think that may be one that we come back to, but I think, yeah, it's really democratizing fields that needed a lot of Specialized knowledge before. The thing I'm really impressed with the latest version of generative AI is how well it can generate code. I mean that was the big change for me that was so impressive. I'm absolutely not a purist when it comes to coding. Like if you gave me a blank, blank jupyter notebook to code on and have a panic attack. The way I learned and the way I still function is to take somebody else's code and hack it until it works for me. So this is an absolutely perfect thing for the way I code because it's never right. It's never right to begin with, but it gets you so far along that first path right now that it's incredible. So yeah, the ability to manipulate code, the ability to give it code and say make this faster, make this more efficient, make it more Pythonic, I think that's incredibly exciting. Make the fact that you can just feed it a data set and say tell me what are the key features about this? I think that's incredibly exciting. But all the non data use cases as well, so the. Please help me write a presentation about this, please help me present this back to stakeholders, please help me summarize this. Well, suggest some good data visualizations on this data. There's just so many opportunities.
That's brilliant. And I do find it interesting that it's actually rare to be starting writing code from scratch. Quite often there's an existing code base that you want to work on. So just editing code written by GPT or whatever is very similar to writing code written by one of your colleagues.
But that's not the way we teach it. Right. Like we teach people, hey, here's a blank notebook. You need to structure your code from scratch and I can't remember every import statement. I have to go and steal it from somebody else. So usually myself in an older version. Yeah, it's perfect.
Absolutely. I'd love to talk about the non data use cases later, but just for now, if we continue on the theme of data use cases, is there a difference about how different data data roles are going to use Generative AI?
Yeah, I mean obviously if you're a data analyst, if you're in a more code heavy role, you're probably going to be generating a lot of code with it. If you're doing summary analysis, there's so many first drafts you can get out of that. I think. Yeah, there's so much in terms of all of the bits that support being a data scientist that aren't data and aren't coding. These are the Things that you really have to teach that. I wish somebody had told me as a young data scientist that maybe half the job is actually the technical bit. The rest of it is working with stakeholders, getting it into production, writing the business case to support it, writing the presentation to say, hey, this is why you need to approve it in the go, no go, all of that kind of stuff. And generative AI can help out with all of those aspects of it as well. In terms of non technical use cases. Yeah, Reporting, project management, all of that. Way to reword things. Lesson plans, if you're teaching at all, for example. Yeah, it's just got so many opportunities.
It's really exciting that you mentioned all these different bits of a sort of more holistic workflow that aren't necessarily just about crunching numbers. So have you got any examples of how you've used GPT or other AI for these non technical bits like creating reports or project management or things like that?
Yeah, well, it wrote my bio for this podcast, so that's helpful. I fed it the information and it constructed something sensible and I had to reword it at the end because of course you do. It's great for a first draft and everything. Never get as a final draft. But yeah, that's a great example. Great example. Literally, we needed to develop a lesson plan within Kubrick where I work, where we train people. And yeah, it gave a really good structure for. You can tell it's over how many days you want to learn something, in what depth, and it will give you a structured guide. So actually one of my consultants. So I train machine learning engineers. One of my consultants that I've trained recently is using it to run a marathon. So he's never run a marathon before, but he's setting up a project to follow ChatGPT's plan for training, for recovery, for food, for absolutely everything. And he's doing it all for charity. So if I can give a shameless plug and link for that, I'd love to. He's calling it the Mariathon.
Okay, that's pretty cool. It sounds like he could end up training really well or it could be like, well, yeah, well, he's not gonna do it. Can you put the prompt where it's like, make sure to like, spend plenty of time on the couch watching TV.
As it seems to be. Yeah, but I think that it's a really interesting project. I think we're just scratching the surface with what people can do. But yeah, you can use it for structure presentations. It gave me some great examples. Yeah, you can use it for paraphrasing things. It's really helpful with that. Internally, we had a bit of. We had a strategy day and we had a little exercise where we had to draw a shield. It sounds cheesy, it's one of these icebreakers, but it's actually pretty good. And you had to put different things in the quarters of the shield to like represent your life. So I had Dall e draw mine and it was really good. Far better than I could do with my design skills.
Nice. I am curious as to what went into your coat of arms then.
It was what inspires you? Which was love of learning. What are you proud of? Which was speaking at a big industry event recently. What else was it? What challenges are you facing? I think I gave some sort of women in data answer and something in your life right now. I can't remember what I said now, but it did. It gave me like, I gave it the most basic prompts. I was like a red haired woman speaking in front of a crowd. And it sure did draw a cartoon of me. That was all I gave it. Red haired woman with glasses. She loves it.
It's nice that you formed the image of a generic red haired woman with glasses. All right, so getting back to AI and data. So one of the big sticking points is when data, people have to work with people who don't have a data background. So can you just talk me through how you use AI for this?
That's. I mean, the barriers to entry have never been lower on this, right? You can just show someone this and explain how it works. Like, my mom is a retired English teacher and she's using it on its. I think that's the. In show business they used to say, will it play in Poughkeepsie? That was, will it reach the mass market? So if it will reach you in Portage, Indiana and a retired English teacher, then I think it's really, really past the hype cycle and into reality. It can do a lot of things like summarize advice for you. It can help suggest visual aid. I actually asked it this question in advance. It had some very good advice which consisted mainly of know your audience, simplify your language, use visuals, focus on the big picture, be prepared to answer questions and practice. Which is all very good advice. I think if somebody came to me and said, ask me for that advice, that's probably what I'd give it.
Yeah, that is great advice for preparing a presentation. So GPT seems to have stolen the limelight in terms of what generative AA is. But There are tons of other models around, tons of other different application like models of different purposes. Are there any other models that you think data practitioners ought to be looking into at the moment?
I think for language models, ChatGPT is really the runaway success story and I think it's still my favorite. I've played with a few of the other ones, but it's really good. But it's still just text based, which it will remind you every time you ask it to do something that's not text based. So there's ones that can draw images. So Dall e also by OpenAI Midjourney is quite cool. There are ones that do video. I haven't put as much with those, but there are a number of emerging ones out there. I've just been playing around with an app called Retrado that will take pictures of you and generate different images of you in various art styles and more importantly your pets as well. So I can have my cat as a princess in space if I want. And really that's what we've used the Internet for, so it makes sense that's what we'll use generative AI for, I suppose.
Yeah. If you're training on stuff that people have created on the Internet, then that's what you're going to get back out of it as well. So given that you're head of AI, you're managing a team, I'm curious as to whether the use cases for managers are different for individual contributors.
I think that's a big one. I think generally speaking, the more senior you get, the more sort of responsibility you have to think about the big picture and the more you have to think about AI ethics. To some extent, yes, that's everyone's job. We all need to think about AI ethics, but really it's the manager's job to be thinking about are we using this safely? Are we using this for the appropriate purposes? And those are important questions to ask. So, for example, when we do training, we have assessments that go along with that and ChatGPT can pass our assessments. So as head of AI, I had to be the one to identify that and raise that and say, hey guys, what are we going to do about that? How are we going to adapt? I should point out we're in good company. It's passing things like medical exams, the bar, the Wharton mba. So we are in good company there. But I think it's that, what are the implications? What's the bigger picture? How do we do this safely? How do we respect privacy? How do we respect intellectual property. Those are the sort of big questions that the more significant you have to answer the strategic level ones. I think also there's just more reporting, there's more admin, so there's more opportunity to use it for those sort of non technical roles as well. But I think it's the putting it in context that's the most important thing.
So that point you made about assessments is really interesting. It's something we've been looking hard into datacamp as well. So someone on our assessment team is saying one of the big problems is that writing a good assessment question, it has all the same key features as writing a good prompt because you want to be really precise about what you're asking for. And so that's why GPT is really good at passing assessments, because it's a similar sort of optimization process. Going back to the point about managers, do you have any advice for managers who are considering adopting generative AI on their teams?
I mean, safety and security and privacy are the first things. Obviously don't put state secrets in it, don't put PI, personally identifiable information. You don't necessarily know where it's going. You don't necessarily. Well, you do know that OpenAI has access to anything you put into it and similarly anything else. So just be careful. Use it for general things, use it for things that aren't gonna break the world if they get out. But you can't pretend it doesn't exist. When it first came out, I saw two really odd knee jerk reactions to it. One was to try to pretend it didn't exist, like, oh, if we don't tell them about it, maybe they won't use it. Well, come on, it's all over the Internet. It's the most successful product launch in history. ChatGPT is by a lot of metrics, so you can't do that. And the other option was to just consider straight up banning it. Just block it from the servers, don't use it. But that's just shooting yourself in the foot in the long run, right? I think of it as I'm old enough to remember, like back the early days of the Internet and when Google first came out, that kind of thing. It feels very similar to that, that sort of almost wild west nature of it at the time. And okay, we had a dot com bust and all of those things. I expect all of that to happen too. But can you imagine these days asking people not to use a search engine? That'd be insane. And to suddenly just stop people from using any kind of generative AI Blocking it, banning it, whatever, except in very specific use cases, would similarly, I think, hinder productivity.
Yeah, I certainly remember back in the early 2000s being at some jobs where the Internet was very heavily locked down and it became almost a sport to see what, which sites could you actually access.
But even then I basically couldn't program without stack overflow. So Now I've got ChatGPT. It's all good. Brilliant.
And do you have any tips for, like, how you go about sharing best practices for using AI or sharing prompts or anything like that? Like, what do you do to make your team more efficiently use AI?
I think we're all still figuring that out. That's one of the interesting things about it. Just like we all figured out how to use a search engine well back in the day, we're all going to have to figure out how to do prompts well. But at the same time, I think, I think this is moving into another question. But the best qualities, the best data scientists, right, you can teach specific skills, but they're going to change all the time. What you really need are the ability to ask good questions and the ability to critically evaluate information. And with generative AI, that's the most important thing. Still, asking good questions is another way of saying prompt engineering, basically. And again, like you were saying about assessments, the more sort of specific and detailed you can be in asking that question, the more specific and detailed detailed your answer is going to be. And then ChatGPT will, and all the generative AI, don't mean to pick on it specifically, will very confidently give you its answers, right or wrong. And being able to say, ah, hang on, that makes sense, or that makes 80% sense, but I need to tweak this, or that's how it should work, but that's not how it works in practice. That's always been an important skill and that will continue to be incredibly important here, now that we use these tools more.
Absolutely agreed. And just to push you on this a little bit further, do you have any ways of making sure that people are critically thinking, thinking about the responses that they get?
I like when you can tell when people have obviously used it and not edited at all. I do just often reply, thanks chatgpt to that if you see it in an online discussion. Any tips? I think just as you would with, okay, you've asked your friend who's sitting next to you, who's coding with you, who you know generally to be a good programmer, a good data scientist, sometimes they're going to be wrong and don't just take everything at face value. If it's code, test the code. If it's critical information, then still consider looking up sources on that. Don't believe it's citations, it will hallucinate citations still. So it will assemble plausible looking citations to research papers with names and sensible titles. But when you try and look them up on the archive, they don't exist. So trust but verify.
That seems like good advice. I have to say, for data science use cases, I feel like I can usually tell whether something's been written by a human or by AI. But in some cases like, but things like sales stuff or marketing stuff, that stuff, even if it's written by a human, it often sounds like it was written by AI anyway, so it's much more difficult to tell.
But I mean, we've always used templates for these purposes, right? Like I genuinely believe if you're going to do something twice, you should probably automate it. And when it comes to telling people stuff, writing it down is how we automate that. So if you. I've always been a big fan of using like templates for routine communication. Plug in the bits that you need and go. This is just templates plus attempting to fill in the blanks for you.
That's a nice way of putting it. So I'd like to talk a little bit about jobs because I think there's a lot of fear that some jobs are going to be just completely replaced by AI. I guess first of all, are there any tasks or roles that you think are going to be automated completely with generative AI?
I think bits of jobs are going to be automated away. I don't know that entire jobs are going to be automated away again. Just as we saw in the early days of the Internet, there were scares about, ooh, will all brick and mortar shops close? Well, some did, but not all of them did. I still go shopping on the high street. I still like to look at stuff. There are still cases where something physical is still better than what's online. So I think we're going to see a similar transition. Some stuff is going to disappear. We don't program using punch cards anymore, we don't do math using slide rules anymore, but we still program, we still do math. We're just using different tools to do it. So I think those jobs are going to shift rather than completely disappear. And hopefully it's the boring stuff that we get to automate away and we get to focus on the interesting stuff, the fun stuff, the stuff that's going to make a difference in the world.
So in that case, I'd like to talk about cases where you're having a human and an AI work together. Do you see any particular cases where that's going to grow in popularity?
Well, I mean, even the generative AI is that it's human in the loop, reinforcement learning. And that's a pretty productive approach. I think we've definitely seen. There have definitely been some studies about medicine where studies that show doctors using AI do so much better than either alone. I think that's the way forward.
Are there any cases where you think you should just never use AI that it should be blocked?
I don't actually think you should never use AI again. I'm going to go back to the like, should you never look stuff up analogy. Of course not. If you're going to do anything, you're going to do research on it. And this is one of these tools to do research. Again, don't put the state secrets in. How can I best protect my nuclear bunker? Well, no, that would be insane. But there are lots of cases where it shouldn't do everything. But I think in your toolkit, you wouldn't say there are no parts of math where you can't use a calculator. Well, okay, there are parts where, like, a calculator is not going to help you that much. And similarly, there are going to be parts where generative AI is not going to help you that much. But are you really going to tell people no, for very good reasons. You need to go back and use the slide rule now. I don't think so.
There's probably like three slide rule enthusiasts listening to us right now going, yo, it's my favorite way of doing math.
No, I think they're really cool. I have a lovely one and it's a lovely. It's a lovely tactile thing. And it's a great reminder of what we used to do. And I used to. I never used punch cards, but my physics department used old punch cards as, like, our scratch paper. So I have a fondness for it. Right. And there probably is somebody running some fantastic hole punch machine, and you can still use it for machine knitting. Interestingly enough, over jacquard weaving, they still use very much a hole punch. Technology is where a lot of that came from. But, yeah, for the most part, I'm super into hand knitting, but for the most part, I still buy my socks commercially.
The recurring theme so far seems to be, if you've got privacy or security problems, that's going to be the biggest blocker to Using AI. Do you have any tips on how you might reason about this or how you might get around these blockers?
I mean, for the most part, if it involves anything that can identify a human, think twice before you do it. Right. Personally identifiable information is obvious. Things like names, ID numbers, things like that. But especially even combined, a lot of things are identifiable. So if you say that ginger American, especially in a certain tone of voice, I probably know you're speaking about me. So it is something really impressive. Like 95% of a data set can be de anonymized in like four data points. It's really shocking. So be really careful about putting information about people into it. I think that's the biggest thing to say. And then anything you wouldn't want on the front page of a newspaper. I think that's always a good test for AI ethics. If it comes out. Sarah writes a model that, I don't know says rude things about ginger Americans, then just don't. If it got out, if you wouldn't want literally everybody and their next door neighbor to read it, don't put it in a public facing tool.
Okay. So really it's about just thinking about what are the impacts going to be if this becomes public or if you get a wrong answer.
Yeah. And obviously, well, you should know if you're dealing with anything that has a security clearance or intellectual property implications, et cetera. I think those are pretty obvious don't use IT cases.
And I'm hoping most companies and organizations have some kind of guidelines on what are the important or bits of data that ought to be kept secure. So maybe those are the ones you keep away from AI.
Yeah, but I think you also know, I mean, I would be shocked if very many companies have updated their security policies in light of this revolution. I mean, this has only been out since November 30, 2022. This is when it all really took off. Obviously bits of it existed before then, but I think that's the sort of key date in all of this. So I'd be shocked if companies have kept up with it. I know certainly regulation has never kept up with it. That's always been a problem when thinking about AI ethics and data privacy and concerns like that. So it is up to us to behave ethically when using it and make sure that we're not doing anything for evil and to make sure that we're protecting ourselves and our company's rights when we're using it.
Absolutely. So just moving on from the impact on jobs and tasks to upskilling, I Think AI has some pretty big implications for education. Yeah. So to begin with, how do you think it helps people learn new skills?
I mean, you can just chat with it, you can just ask it. It's incredible. Explain time series to me and you can have a chat with it and you can say, oh, tell me more about that second paragraph. And it will. And is it going to be right about absolutely every single detail? Well, probably not. So do be careful about that and do verify that. But it can basically be like having a private tutor now, which is incredible. I'm a big fan of duolingo for language learning. I'm on it all the time. I'm learning far too many languages and what they've done with it I think is incredibly impressive. You can do really tailored learning. I think this is the thing we know about education in general, right. Is that really focused practice on the areas that you're getting wrong is what helps you upskill rapidly. And this is where AI powered learning has such great potential. Because as I'm doing my French lessons, it can say, oh, she always gets a subjunctive wrong. And it can give me loads more review about that and help me with that. And similarly, I assume if I'm learning programming languages, for example, on datacamp, I'm going to be able to get, ah, she always forgets, I don't know, to define the arguments there or something. I don't know what common mistakes I make, but usually just typos can help me catch that too.
So the idea of personalization, so being able to figure out what is this particular learner doing wrong seems really powerful. It really is, absolutely. Are there any other sort of areas where you think, okay, this is a game changer, whether this is going to really improve people's learning performance?
Yeah, I hope so. I mean, if you've ever sat through really standardized, boring corporate learning, you really hope that it gives you something other than that PowerPoint presentation with a bad quiz at the end. We've all done that. There are things that we have to do regularly for very good reasons, things like anti barbary and corruption training. But that could certainly be more engaging. That could be stickier in terms of. It sticks in your brain better, I think. Yeah. That level of personalization, interactivity, adaptability, that's something that I think in the past, for the most part, you would have had to work with someone really directly in a small group to get. And there's so much opportunity to get the generative AI to quiz you. So it's great for practicing Job interviews, you can get it to role play a job interviewer and ask you all those sorts of questions and then it can even evaluate the response. So if you chat that back in, I think there's so much opportunity to quiz you. When I was a kid, when I was studying for my exams, I'd always get my mum to quiz me and that was the best practice. We go in and ace it based on that. So yeah, now you've got your own private tutor potentially.
Yeah. AI tutors, that's feature coming soon to Data Camp. So I do like that example. Yeah, that's very nice. The idea of being able to converse with someone, practice your conversations, that does seem a very powerful way of learning. So just on a related note, does the fact that you can use AI, does that change the skill set that you need, particularly for data analysts and data scientists?
I mean, it does, but again, I still think those most important skills are always asking the right questions and critically evaluating information. And so that just makes those even more important because asking good questions is another way to say prompt engineering.
So in terms of technical skills, if AI can generate your code, does that change your relationship with how you learn about coding?
I think there's just less rote memorization that has to happen. But again, in my career I have seen this progression that has happened, Right. It used to be back in the day that if you were writing some complicated thing in C or C whatever, like during my PhD, you had to code in those equations by yourself, right? You had to have that math, you had to code that in specifically and okay, that made the code run way faster potentially. There were good reasons to do that. Nowadays we don't do that anymore. We use Python packages. If we're programming in Python, somebody's done that function for me. I don't need to write a neural net from scratch. I'll go off and use TensorFlow or PyTorch or whatever. So it's just the next level of abstraction we were already getting there with. I thought the next step up from packages was going to be pre trained models. And to some extent this is that because it's trained on the entire Internet, but I think it's just that, it's just that next level of abstraction up. And why wouldn't we, when appropriate, use the more powerful tool to do that?
I definitely agree with that. I'm wondering because this is all sort of built on deep learning and the whole area seems like really important to like you need a few people to understand what's going on. Do you think these natural language processing skills or deep learning skills are going to become more important? Or is it just, well, this is all done for you. We don't need that.
It depends on what you want to do. If you just want to use the outputs of these things, then no, I don't need to know how a search engine works to trawl the Internet. But if you want to work with it, if you want to be on the cutting edge of technology, if you want to be adapting it, if you want to be making your own, own tools with it, then I think, yeah, absolutely. Natural language processing and deep learning are some of the most important skills. Those are especially thinking about just text based models. If you're thinking about do you want to do image generation, do you want to do video generation, then you need, obviously on top of that, computer vision skills, but you do still need some NLP because it has to be able to interpret prompts. So yeah, it will be there. But again, how many of us are really writing our own Python packages these days rather than using that output to write the code? I think there's a parallel there as well.
That seems like sensible advice. And so I'm wondering in general, how does the existence of generative AI change your decisions when you are trying to hire data professionals?
That's interesting. I mean, if they didn't know what it is, they've clearly been living under a rock. So I think that's genuinely true though, because you do want people to be able to be aware of trends in the industry and have ideas and opinions about where things are going. So I think people having an awareness of it and people having interesting insights on how to use it, I think those are probably great interview questions, but again, I'm still always hiring for can you ask good questions? Can you critically evaluate responses? Are you creative? Can you learn quickly? Can you adapt quickly? All of that's in practice now. You need to do all of that. You need to do it to just successfully use the tool full stop, but also to be able to adapt to a changing workplace that's going to integrate tools like this more and more.
Excellent. Has it changed the profile you might look for or are there any new skills that you think more important now?
I do think NLP and deep learning are going to become more and more important. I think that's absolutely the right shout on that. But I think individual skills and technologies change a lot and you can learn them and you need to be constantly learning. I think the only thing that we can guarantee about this industry is that it's going to keep changing and it's going to keep adapting and we're going to keep building on what we're doing. It's going to be more interesting, more powerful and that's going to use different skills. Right. And are we going to be using Python in 20 years? Probably not. I mean, some people are still using Fortran, but hey, for the most part, no, there, there are trends, there are shifts in what we do. This is a big one, this is a big step change. But the core skills, are you logical, are you creative, are you pragmatic, can make things make sense? Those are the sort of more fundamental skills rather than specific technologies. Because I can go to a data camp course tomorrow and refresh myself on time series if I need to. That's not the point. It's do I know how to find that information? Do I even know how to ask questions about this? Like, hey, what kind of a problem am I talking about? That's a more important question to ask than what specific piece of technology? Or how do I write these five lines of code about it, framing the problem, thinking about how to solve it, how to communicate the results at the end of it, that that's always going to be more important than a specific skill.
One thing you've mentioned a few times is the idea of prompt engineering and it seems that this might be a real job. I'm never quite sure if it's like, if it's just a task or whether it's like a whole job in itself. Can you just tell me a bit about what it involves?
Yeah, I mean, prompt engineering is another way of saying asking the right question. I think there are tricks to getting it to do what you want, so giving it context again. But a lot of these things are just good advice for how to tell a human to do stuff as well. So give it context, tell it why. So in this situation, I want you to be a data scientist using Python. So give it that prompt. Ask specifically what you want. If you're looking for a format of an answer, give it an example. Say, hey, give me an output like this. Again, really great advice for dealing with humans as well. So yeah, I think it's going to be a super important skill that quite a lot of jobs have. I think in very limited circumstances that is going to be a specific job. But I think that's going to be part of a mega pipeline in certain areas. I think you do see Search engine optimization, I think is again a good comparison. Is that the job title in a lot of Cases, probably not. But if you have a marketing role, that's probably an essential skill. And in a big enough, specialized enough organization, you might have someone where their only job is that. But I think it's more and more a skill we all need. But it's a skill we can still all use because again, for dealing with humans, giving context, saying explicitly and clearly what you need, giving it an example of what good looks like. Still, all really great advice.
Excellent. So maybe a job in big organizations, but otherwise it's just a skill everyone needs.
How to search stuff on the Internet right now is a skill that everyone needs. Right. How to phrase that question properly, how to sort through all the crap, how to ignore the ads, how to do all of that. We don't even think of those as skills anymore. Anymore. But 20 odd years ago, we were all figuring this out for the first time and it's what we're doing again.
I think with Internet search, it does sound like an Internet job. What do you do? Well, yeah, I just Google stuff all day.
I've had jobs like that.
Let's talk about your work at Kubrick. So can you tell me what you're working on at the moment?
Sure, yeah. So we're training the next generation of, well, lots of data professionals. So as head of AI, I look after our machine learning engineering track. So the people who are going to be potentially using this stuff on a full time basis, we have other streams as well, but yeah, training them up in the basics of all of the business stuff around this as well. Because again, half the job is actually getting it implemented and communicating it, training them up with the basic skills that we need and then sending them out to client sites and supporting them out there using machine learning skills. So we're spending a lot of time obviously talking about this new revolution in AI and how interesting it is. Yeah, lots of good conversations, lots about obviously around the assessments. We had some pretty serious assessments that were a couple of weeks after ChatGPT dropped and we ran the exam through it those days, it was passing it at good marks rather than incredibly perfect marks, but it was having an honest conversation with them about, look, you can do this, it can answer the questions. We're not going to lie to you, we're not going to hide that from you, but you're not going to get the benefit of really being able to challenge yourself and really being able to test yourself if you use it to effectively collaborate. Right. Because rather than it's copying from someone. Right. The equivalent, I think, of using ChatGPT on exam is closer to collaborating with a human. It's closer to plagiarism than I have automated something. So setting expectations around that has been a really interesting discussion. We always talk about AI ethics and I think the AI ethics of this is a big one as well. All those same questions about privacy and security, but also where is it going? They're all worried about is this still the right thing to train in? Are we going to have jobs at the end of this? And yeah, I actually think it's more important than ever.
Yeah, it's a thorny issue, the idea of using AI for assessment because it's cheating, but if it's something you're going to use in your job, then maybe it's something you want to be able to use when you're passing the assessment as well.
Exactly. Because I was a hiring manager at a bank, I worked at one of the world's largest banks and it drove me crazy when we would get young data professionals who would join us and would insist on doing absolutely everything from scratch with no collaboration because that was how you're supposed to do it in school and university. But that's not what I want you to do on the job site. Like if you can ask Bob next to you and Bob can say, yep, this is how you do it in five minutes. Or if you can find it on Stack overflow. I would much rather you do that than spend two days hashing it out for yourself less efficiently. Like, this stuff exists, it's been tested, it's been tried. I think this is always the example we use for using pre made Python functions. Don't write a linear regression from scratch. What are you doing? Use Scikit, Learn. I think that's where we're headed with this as well.
All right, nice. And do you have any success stories around AI that you can share from Qubit?
Well, have to be a bit careful about client confidentiality. I think there's some really interesting stuff that's happening in life sciences with large language models. I went to an event on that in industry. I think that's incredibly cool. There's lots of options for developing new sort of computational chemistry with it, for looking for new drug reactions, for doing sort of meta analysis on past research papers. I've seen some really interesting examples of that. I think that's an incredibly interesting area that's going to be relevant well to everyone because we all have to deal with healthcare at some point in our lives. I think that's incredibly cool. We've definitely seen people switch to things that are a lot more efficient. Different versions of automating things, being able to automatically classify documents, for example, looking at supply chains, there's just, there's opportunities absolutely everywhere. If you're like, hey, that could be done more efficiently, there's probably a way to use technology to do that.
Excellent. So lots of opportunities out there then for people wanting to adopt this stuff. Do you have any final advice for data managers or data teams who are wanting to try their hand at AI?
Yeah, I mean, just try it. The barrier to entry has never been lower. It's just there. It may not stay that way forever. Right. It may not always be so freely accessible or so generous accessible, but it's a big step change. It's exciting. So on the one hand it's cool, be excited about it, right? Absolutely. There's so much potential. On the other hand, calm down. It's also probably not the end of the world. It's probably not Skynet. I think there's so much opportunity, but also keep some perspective on it as well. We've been through, I have personally been through a few revolutions of the technological variety. Right. We got the Internet, we got advances in search engines like Google. Some stuff phases out, but some new opportunities are made every time. We wouldn't be talking right now without a bunch of them. I'm in Chicago, you're in New York. Look at what we've managed to do. There's some kind of automated transcript going on in the background. I couldn't have imagined that 20 years ago, but here we are.
Technology is amazing and I do like the phrasing that. ChatGPT is probably not Skynet. I think that's optimistic.
So I may look to regret that maybe like the end of the world, see it on a newspaper, probably not Skynet.
Nice. All right, well, thank you for joining me on the show, Sarah. That was really informative. Yeah, great stuff.
Thanks so much.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra