#142 Is Data Science Still the Sexiest Job of the 21st Century?
19 Jun 2023 · 46 min
In this episode of the Data Framed podcast, host Adele (Data evangelist at DataCamp) interviews Thomas (Tom) Davenport, a renowned professor, author, and analytics advisor. The conversation revisits the 2012 Harvard Business Review article "Data Science is the Sexiest Job of the 21st Century" and examines how the field has evolved over the past decade. Davenport explains that data science has become institutionalized, fragmented into many specialized roles, and is still a coveted career, but organizations often lack clear definitions, certification, and a data‑driven culture. He outlines investment trends across industries, noting that financial services, telecom, and pharma lead adoption while manufacturing lags. The discussion moves to cultural obstacles, the need for senior‑leader sponsorship, and the importance of tailored data‑literacy programs. Davenport describes the proliferation of new job titles—data product managers, ML engineers, data engineers, translators—and debates whether specialization or generalization is the optimal career path. He critiques the current educational landscape, the scarcity of PhD programs, and the need for clearer certification pathways and internal ladders akin to software engineering. Shifting to AI, he defines what it means to be an AI‑driven organization, presents three strategic archetypes (new business models, operational transformation, and customer‑behavior change), and offers practical advice on prioritizing use cases. The conversation then explores the transformative potential of generative AI, its early‑stage impact on coding, content creation, R&D, and knowledge management, and the ethical, legal, and security considerations it raises. Finally, Davenport predicts that within 12 months generative‑AI front‑ends will appear in most software products, conversational interfaces will become commonplace, and highly customized fine‑tuned models will proliferate across industries. He urges listeners to experiment aggressively, start small, think big, and prioritize building an AI‑savvy culture.
Chapters
Hi, I'm Maggie, VP of Curriculum at datacamp, and I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy executives to cutting edge generative AI for developers, and everything in between. Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power your data and AI Transformation Journey on datacamp.com.
Well, I think the time to move on these things is now. The Morgan Stanley people have been working with OpenAI now for 18 months, and Deloitte has been working with OpenAI for 18 months on code generation. So you don't want to just sit back and wait for things to develop. It may be a hard thing to be a fast follower on, so start experimenting aggressively. Think big about what it's going to do for your organization and how it's going to transform it. So think big, but you start small if you need to.
Hello everyone.
Welcome to Data Framed. I'm Adele, Data evangelist and educator at datacamp, and if you're new here, Data Framed is a weekly podcast in which we explore how individuals and organizations can succeed with data and AI.
Hi.
About 10 years ago, Thomas Davenport and DJ Patel published the article Data the Sexiest job of the 21st century. In this article, they describe the burgeoning role of the data scientist and what it will mean for organizations and professionals over the decade to come. In a lot of ways, they popularized the job title as we know it today. So much so, that the truism data scientist is the sexiest job of the 21st century was even mentioned in the previous show description of Dataframe just a few years ago. However, as data science has become more and more institutionalized as it has morphed from a nice to have to a must have for every boardroom Today, as technologies like AI and ChatGPT continue to blow our minds with their ability to perform data science tasks, this begs the question, is data science still the sexiest job of the 21st century? So we invited Tom Davenport to Dataframe to share his perspective on data science and AI. Today, Tom Davenport needs no introduction. Apart from co authoring the article I mentioned earlier, he's also the President's Distinguished professor of Information Technology and Management at Babson College, the co founder of the International Institute for Analytics, a Fellow of the MIT Initiative for the Digital Economy and a senior advisor to Deloitte Analytics. He has written or edited 20 books and over 250 print or digital articles for Harvard Business Review, Sloan Management Review, the Financial Times, and many other publications. He earned his PhD from Harvard University and has taught at the Harvard Business School, the University of Chicago, the Tuck School of Business, Boston University, and the University of Texas at Austin. His most recent book, all in, on how smart companies win big with artificial intelligence, couldn't have come at a better time given what we've seen in the industry today. Throughout the episode, we discuss how data science has changed since he first published his article, how it has become more and more institutionalized, his views on AI and where he thinks it's going, and a lot more. Also, this week is our Radar AI Conference. If you've been following the AI space and have been interested in its potential impact on data, you'll definitely want to tune in. Tom will be there alongside a host of awesome data and AI leaders discussing what AI and ChatGPT mean for data science, data literacy, and a lot more. The link is in the description. As always, if you enjoyed this episode.
Do let us know in the comments.
And ratings and on social and now onto today's episode, Foreign.
Davenport. It's great to have you on the show.
Thanks for having me.
You know, 10 years ago you co authored the article with DJ Patel in Harvard Business Review titled Data Science is the Sexiest job of the 21st century. There's a lot to unpack in how data science has evolved since the article, but maybe to set the stage for today's conversation, is data science still the.
Sexiest job of the 21st century?
And if so, why yes? And if not, why not?
Well, first I would say I think it was a memorable title, but there were many non sexy aspects of data science at the time. And I remember thinking as I was interviewing the people for the article, I said there's a whole lot of data plumbing going on here. That's not sexy at all. But it was obviously sexy in terms of the desirability of hiring these people and the labor market and so on. I think that's still the case. It's changed a bit in that there are many other sources of data science expertise than the traditional sort of PhD in physics types who were really the only thing around at the time. And the job has fragmented a fair amount. There are these different roles and then we can do more with citizen data science than we could at the time. Certainly we realize now these are not unicorns. They're pretty good at creating models. But now we realize that's not all there is to data science, to successful data science anyway. So I don't think there's a lot of clarity in organizations about who is a data scientist and who isn't. And we haven't really succeeded very much in creating certification for them and skill testing and so on despite a few attempts. But in general it's still desirable job. And if you have the skills, it's great to be a data scientist.
And you recently co wrote another article with DJ Patel on is data science still sexy? And data science in a lot of ways you mentioned in the article has become a lot more institutionalized. We've seen over the past few years a significant increase in investment in data science by organizations across various industries. How would you characterize the current landscape of investment for data science that organizations.
And leaders are doing and how do.
You think that shift and that increase has impacted the state of data science adoption today in comparison to when you first wrote that article?
It's interesting. I think data science is much more institutionalized. In some companies it has become the preeminent job in the sense the company realizes is it's a data driven business and they are trying in all sorts of ways to understand their data and develop products and services based on it and so on. But sadly, I think that's still a minority of companies. And in most companies there doesn't seem to be a data driven culture. A lot of the decision making is still not data driven. A lot of the senior executives still don't understand what's so important about this. And so in the majority of companies, I think even though there may be some data scientists, they're still on the margins of a business and their work is not given the respect that it deserves, I would say. But you know, that was true with traditional analytics as well. A relatively small percentage of companies decided that they wanted to compete on the big basis of their analytical capabilities. And a relatively small percentage of companies are competing on data science and AI today, getting larger, and that's great progress. But still a minority, I think.
Yeah. One thing, you know, early on that we saw is that data science adoption really shifted by industry as well and changed by industry. We saw financial services organizations try to become data driven and adopt data science much quicker. Data rich industries tend to be much more skewed towards adoption faster than other industries. Can you give us maybe an overview of where data science is being most widely adopted today? Which industries outside of technologies are leading the back and which industries are maybe Lagging behind.
Sure, yeah. Still the case that takes a lot of data to do data science well. So if a company doesn't have a lot of data, they're going to be severely handicapped. And I still think the biggest industries are financial services where there's a lot of data, both banking and insurance and certainly investments and hedge funds and so on. A lot of data in telecom. So telecom I would say is. It doesn't have the same level of kind of cultural centricity as it does in financial services, but it's pretty powerful. And I just a few weeks ago wrote a piece about AT&T and how they're. They have a lot of data scientists, but I think quite interestingly they have developed a very active sort of citizen data science program. They've done a lot to democratize the activity and I think that's what many organizations need to do if they're serious about data science. They can't just rely on a relatively small percentage of highly trained professionals. Other industries. I recently did a session with Johnson and Johnson and it's mostly a pharmaceutical company these days. And this was for all the people who are interested in data science is the first one they'd had. I've done this a lot. Speaking of the first one, they got 5,000 people to sign up. So that tells you there's a lot of data science going on in the pharmaceutical industry and I see it elsewhere in that industry. Manufacturing has been relatively slow to adopt data science. It's coming on with predictive maintenance and digital twins and so on, but it's still behind most organizations. Some really high tech manufacturing has a fair amount of it. I've written some things about Seagate, for example, and their use of image detection, image analysis systems with AI to detect problems in electron microscope images. So that's quite sophisticated, but it's relatively rare I think in that industry. And you're starting to see it a bit in professional services, not just consulting to other organizations, but in audit and tax and law. Even still, I think as AI enters law, you'll see a lot more of it. Mid sized companies tend to be less aggressive than either startups or really large companies. So that's another distinction to me.
Yeah, that's definitely the case and we've seen that as well in case of data culture adoption as well. From our perspective, keeping here on the theme of data culture and creating a culture of decision making and data driven decision making, as you mentioned, that's an obstacle that a lot of organizations have suffered with in the past decade or so as they increase adoption, why do you think that people component and culture. Cultural component is still a major obstacle for organizations and what have you seen to be a good pattern or success stories from organizations who've been able to overcome that hump?
Yeah, well, I think there are two primary issues that are related. Culture tends to trickle down from the top of the organization. And if you don't have senior executives who are really committed to data science and analytics and AI as really important resources in the business, it's going to be much harder for the rest of the organization to adopt a data driven culture. And a related factor is that most organizations, we've had this feeling, there's that old phrase, you can lead a horse to water, but you can't make a drink. And I don't know if that's true in Europe. It was popular at one point in the United States. And we think that because we develop these information systems and analytics and AI and so on, that people will actually use them. But that's not always true. And we don't really. We invest a tiny fraction of the amount we spend on technology in cultural change and education and initiatives to create a more data driven culture. So it's like 1% to 99%. And that's despite the fact that every year I do a survey with large companies, typically about 100 or so large companies, mostly in financial services, but other industries as well, with new vantage partners. And every year the CEO whom I analyze this with, Randy Beans, has a question. What's the primary cause of your challenges with data and analytics and AI? Is it technology or is it human cultural organizational process factors? And generally it's between 80 and 90% human organizational process culture factors. But nobody spends 80 to 90% of their budgets on those things. So there's a real imbalance between what we spend on technology and the attention that technology gets and the attention that the cultural side gets.
In a lot of ways, there's a pitfall of shiny toys here that organizations fall into. It's very easy to develop a high quality, cool, robust predictive model that may not or may not get actually deployed into production. But a lot of the times enabling folks with low code tools and data driven decision making, data literacy can get you a long way. We've seen in a lot of ways organizations shift their priority and create data literacy programs. Have you seen that succeed in organizations? Is that only enough to create a data culture or is there an additional mile that needs to be crossed there?
Well, it's a good thing to do that While it's a good thing, it wasn't nearly enough. It should be tailored to particular parts of the business. There should be a human component face to face, probably where you can discuss these issues, not just watch a few minutes of online video. And so just good, but not enough. And you know, a friend of mine, he's recently changing jobs, but he was the head of analytics and AI data science at Eli Lilly and he said these cultural change programs are really multifaceted. You have to do data literacy. You should do it differently for different levels and different parts of the organization and so on. But you should also have one on one things with senior executives. You should have communities develop around the organization. You should have behavior change programs in meetings. I always thought the best thing you can do is have somebody in a meeting say excuse me, but do you have data to support that hypothesis? Or oh, by the way, you're showing a correlation, but that doesn't mean there's causality going on. That's the best thing that could happen and maybe the hardest thing to change.
It's one thing to develop skill sets, right? But it's another thing to apply it in the flow of work and more importantly to develop that healthy data skeptics within the organization where there is an open and honest conversation about the data around how can you action that in a particular business setting? Now let's shift gears and discuss also how data science has matured from across different dimensions. You mentioned earlier in our discussion how the data science role, responsibility and skillset has evolved as well. Maybe walk us through some of the key shifts that you've seen in the data science role in the past few years. How has that differed since the nascent days of data science as a profession?
Yeah, well, one big difference is that data scientists were the only job that were supposed to advance data science and we found out that didn't work very well. These people are not unicorns. They can't do it all. They're particularly good at developing models that fit a set of data and maybe writing some Python code to make it all work. But some of the other factors not so good at, maybe not so good at interfacing with the business and building their trust. Maybe not so good at building a machine learning infrastructure at scale. Maybe not so good at changing the organization in all the necessary ways to make effective use of their models, changing the process, changing the skills, changing the culture, et cetera. And maybe not so good at ongoing management of the system once it's been put into deployment. Assuming you're lucky enough to get it into deployment. Not very many systems were. That was part of the problem. So we've had this evolution of disaggregation of jobs. So now you have data scientists and you have machine learning engineers and you have data product managers, which I think are the single, in a way, most important job because they're the ones who integrate all this stuff. You have ML ops engineers in some organizations, you have translators. I think many of those translation functions can be data product managers. But you really have seen a proliferation of data engineers more broadly to take some of that data wrangling off the data scientists. You've seen a proliferation of these jobs and I think it's a great thing. But they have to be coordinated in the context of a particular project and that's where the data product management role often comes into play.
So in a lot of ways, the story of the past few years have been I've seen a debate raging on in the data science space between is the optimal path for a data science profession specialization or generalization? Do you think that as data science has matured, the path for succeeding in data science is specialization, becoming a specialist in a particular area of the data science pipeline, for example?
Well, I think it depends to some degree on what your skills are. There certainly are some data scientists who like dealing with managers, who like overseeing a project, who understand how to create a model, but realize that's only a small fraction of the job. But they're pretty rare, to be honest. And most of the time people got into data science because they like modeling, you know, they like coding. Those were the initial skills that were considered most important and most valuable. It's why you needed PhDs in these quantitative disciplines in many cases. And I often say librarians sometimes like books more than people. System developers like computers more than people. Data scientists sometimes like models more than people. So I think you have to go with the skills and inclinations that you have in most cases. I think you're going to be better off with that kind of specialization. And the data scientists who really like that broader range of activities can move into data product management, oversight of the data science function and so on, where they have more managerial activities and less kind of day to day modeling stuff.
And what's interesting, speaking of skills here is not just how the skill sets and roles and responsibilities of data science have evolved, is the also the educational landscape within data science and how education within the space has evolved to unlock that specialization. Can you shed some light maybe on the changes of the educational landscape within the Data science industry and what that looks like today.
Yeah, well, you guys are in that business, so you probably know more about it than I do. But from my perspective being a professor, we at Babson College have a Master's of Science in business analytics. There are literally hundreds of these programs in the United States alone. Five years ago I wrote about this and there were over 200 just in business schools. And there are also programs in data science and analytics and AI in engineering schools, computer science schools, etc. So they're really all over the place. And in many cases, I think there are two problems. One is it's hard for somebody who's applying to one of these programs to know, okay, well, what am I getting mostly? Am I getting something that lets me do hardcore modeling? If so, I better have some pretty good statistics skills before I go in, because these are mostly one year programs. Or am I getting something that's more oversight of the entire process or. At Babson, my school is mostly known for entrepreneurship and we try to take an entrepreneurial spin on business analytics, which is a little unusual, but valuable if you want to go into that combination of emphases. So students don't know what they're getting. And in many cases I don't think that one year is enough to create a great data scientist. Somebody was telling me the other day they think what it really does is create excellent citizen data scientists. And that's probably true. And then you end up focusing on some part of the business domain, supply chain or marketing or whatever, in terms of getting a lot of expertise in that and knowing how you can use data science to advance that, that particular aspect of the business.
And you mentioned that especially. It's great. Like a lot of programs are great, creating citizen data scientists. We see that on the employer side as well. A lot of times employers have a lot of ease in getting junior data scientists, data analysts in the door when it comes to hiring Right. And recruiting, but struggle in getting that extremely proficient, advanced data science talent within the organization that has a lot of experience in machine learning, modeling, deploying these models, etc. What do you think needs to change in the education industry today, or education in general, to be able to create a healthier pipeline from that junior talent talent to advanced talent.
Well, it's interesting, there are a ton of master's programs, not very many PhD programs in the world in data science. So that would be one, one thing. I think data science is almost by definition a multidisciplinary activity, and universities don't tend to do well at that, they're good at creating statisticians or physicists or whatever. But if you're combining a bunch of different skills, which may come from different parts of the university, not so good. Generally. I think somebody who has a master's degree could be encouraged to go back and get more training, maybe to get a PhD or more specialized training in certain aspects of data science. I think if you are highly motivated to acquire new skills, there are tons of places where you can get them. Your organization, there are tons of these online courses by Coursera and Udemy and so on. If you're highly motivated, you can get the education that you want, even on YouTube. But most people don't really know enough about what they want. And so I think it means that organizations need to develop categorizations and certification programs within their companies to say, okay, here are the skills that you need to really be level one data scientists. Here's some places you can get them here. If you want to be a data product manager, here's what you need. If you want to be a data engineer, here's what you need. A few companies are doing that, but they're not nearly enough out there.
Yeah. And this connects to another question that I want to ask, is that a lot of organizations, while they've made strides in building data teams, I think if you want to compare data science maybe to a natural counterpart, which is software engineering. Software engineering tends to be a lot more mature when it comes to leveling. Right. You get a junior software engineer, level one, there's a level two, level three, you become a staff engineer after that, distinguished engineer, et cetera, and so on and so forth. Or you become a people manager. Data science doesn't necessarily have that. It's not codified across the industry. You see organizations trying to do that for their specific use cases. What is the solution to the laddering problem in data science? Because I do see that in the long term, this can create problems where data scientists feel stagnant, depending on the type of organization they work in.
Yeah. Well, it's interesting. On the system side, you tended to have some dominant vendors and a lot of Microsoft certified systems engineers, for example. You don't really have that on the data science side. So it would be helpful if some vendors would step up. And there are some organizations out there. There's one that I've done a little bit of work with called iadss. I forget what the letters stand for. That's created a certification approach. There's an analytics certification approach that is fairly popular. It's called a CAP program, Certified Analytics Professional. It doesn't really deal with all aspects of data science though. So we need more people developing certification approaches. And I think if a, if some vendor could inject a lot of money and resources into it, that would probably help, even though it'd be great if open source it. But that hasn't happened.
Okay, that's great. So we talked about data science. How has it matured?
A lot.
But you know your latest book on all in on AI, we need to talk about that as well, given especially the many changes and movement that we're seeing in the AI space. So as data science is becoming more institutionalized, maybe AI is this new frontier for organizations. You mentioned in the book that less than 1% of large organizations view themselves as AI driven. Maybe to first set definitions straight, what does it mean to be an AI fueled organization?
There's a lot of breadth and depth. The breadth is lots and lots of use cases with Deloitte participated in some surveys where maybe 25% of large organizations have seven or more use cases implemented and are getting some positive outcomes out of them. So that's still a small number of. There are companies with literally thousands of use cases that have been implemented. So you need a lot, you need a variety of different types of AI technology in your organization. Conventional machine learning, deep learning, even rules automation oriented technologies. Conversational AI, which is increasingly based on deep learning but wasn't always so. A lot of different technologies, a lot of support from senior executives, a lot of investment in the area, a lot of talent, some sort of ethical framework to make sure you, your AI work doesn't go off the rails. You need a governance structure, at least a center of excellence to manage these activities and select tools and manage the careers of people and so on. So those are the kinds of things. And it takes a lot of money to make that work. But the companies that we found that are doing it seem to be quite successful.
Definitely takes a lot of money, takes a lot of resources. So maybe let's unpack a lot of that and start at the beginning. You discuss in the book on how to become AI driven that there are three strategic archetypes, usually that AI organizations can adopt. Right. Can you explain maybe these archetypes? If an organization is trying to get started, wants to look at a roadmap, a framework for developing their AI strategy, what should that look like?
And you could do more than one. But I think it's good to have strategic discussions around the organization about what are we going to do with AI. So there's the doing something new idea, new strategy, new business model, important new products and services that you're going to offer. And that to me is the most interesting one, although can be hard to do, requires a lot of conviction on the part of senior executives. And it requires a lot of people to understand the business strategy and AI so they can make that connection. The second one is operational transformation. Not just improving things on the margin, but doing dramatic change in how you do key aspects of the operation. So one of our examples of that is Shell, where they're using things like AI image recognition to inspect all of their refineries with drones and image recognition to identify potential problems in piping and valves and so on, so they can send a human out to look at what appears to be a problematic area. Just a dramatic change in how you do maintenance. And they're also doing some really interesting things with subsurface stuff and some probably not enough yet for the planet. But some things also in the space of non carbon based energy forms, where to put charging station, that kind of machine learning analysis. And then the third category is really trying to change customer behavior, where you are trying to do something with AI to make life better for your customers. And that tends to be insurance companies who used to pay you if you died or if you got sick or if you crash your car, but they realized, gee, wouldn't it be better if we helped our customers not die, not crash their cars, not get sick. So it's early days of that. But using AI and behavioral science nudges to create more healthy behaviors, better driving behaviors, et cetera. So those are the three things. Operational transformation is the most common, changing customer behavior, probably the least common.
So maybe let's talk about operational transformation because mentioning that Shell case, that sounds like a very ambitious project. Right. What would be your advice here for an organization starting off when trying to prioritize use cases? Right. Because conventional wisdom always says you need to start small and trade from there versus going for a big project that has a lot of complexity, requires a lot of talent, a lot of data, a lot of overhead. What would be your advice when organizations and leaders are trying to make that trade off?
I think what kind of opportunity is there for this? And you can assess how much money are we spending in that particular area now? How much could we save if we were doing this a different way? You know, for Shell it was takes years to inspect a refinery and the whole refinery in the traditional approach, and it takes days to inspect it in the AI enabled approach. So Obviously that's a big payoff and maintenance and inspection is an important part of keeping things going and successful. And then there's how viable is it? And you have to think about, since some of these things take a while, you have to think, well, how rapidly is the technology maturing? We talked about a company in the book not well known as a kind of medium sized company approaching a billion in revenues, called C Intelligent Solutions. And what they do is enable this capability for insurance companies to let their customers take a photo of their car collision damage and get an immediate estimate for what it's going to cost to fix it. And they started on that well before deep learning based image recognition was at the capability it needed, before smartphone camera resolution was at the level that it needed to be, and so on. So requires some ability to look ahead into the future and see how these technologies are going to be developing.
Okay, that's really great. And we'll definitely talk about what you think about generative AI here, but maybe before we talk about and look forward to the future, in the book you also talk about the human side of becoming an AI driven organization. This connects back to our earlier conversation on data literacy and data culture. Developing the human side is the most important aspect of succeeding in AI, not the technology side. Something we wholeheartedly believe in a data camp as well. Can you explain maybe why this is so important in the context of AI, what an AI driven culture looks like and how can leaders cultivate such a culture?
Well, I think traditionally an AI driven culture required a lot of professional data scientists. But increasingly in part because of generative AI and automated machine learning and so on, I think we're going to be seeing an environment where it has to be a democratic pursuit in the sense of we need tons of people doing this. Even at Shell, I think they've now certified 5,000 of their engineers as knowledgeable in AI. You know, they had some online programs that they recommended and so on. So Airbus did a similar thing in getting a lot of their engineers up to speed. So I think if you're starting from scratch now and you don't have that strong human culture for AI, I think you're much better off thinking about how do I enable a large number of people in my organization, many of whom are already employees, to acquire these skills? And the skills themselves are changing. There aren't too many programs out there on what do you need to know in order to be a good citizen data scientists? How do you use automated machine learning effectively? Even more, I think there's going to be machine learning programs that have. Some companies have already announced them. I'm not sure they actually exist yet. But the front end is generative AI. So how do you tell a generative AI system what you want out of a machine learning algorithm and how do you refine your prompts, how do you interpret the output, et cetera. So we're going to need some new programs of that type as these technologies mature.
Okay, I couldn't agree more. And you mentioned here Generative AI, let's dive deep into it. Of course ChatGPT, Generative AI have garnered quite a lot of attention recently. Maybe discuss.
I haven't heard of any.
Maybe discuss what the generative AI impact or landscape of impact looks like for large organizations, enterprises today and how should they think about leveraging these technologies?
Well, it's potentially quite earth shattering. It's quite early days, but very wide range of potential use cases. Now I think we're seeing the relatively less important ones writing blog posts or writing copy for ads or marketing materials. Really easy to do that. And what's created is not going to be world class, but it's going to be certainly a good input to an expert copywriter and it will very much improve their productivity. I think the whole world of coding is going to change dramatically. And I was talking about this yesterday with some of my friends at Deloitte. We were together doing a presentation for a big private equity firm and Deloitte is saying they expect improvements in coding productivity of like 50% which means that we need far fewer programmers than we thought we needed. And I think more and more the programmers are going to be like everybody else are going to become editors of generative AI code rather than people who write it in the first place. Any writer is going to become an editor more than a first draft writer. So that's something that we have to deal with. I think there are going to be a lot of applications in R and D, both kind of product design in terms of image related technologies. But also pharmaceutical companies are starting to figure out that just as generative AI can model text sequences, it can also model protein sequences or molecule sequences or something like that and see which ones are most likely to be effective. So big changes coming there. A huge amount of change. I think in professional services law is going to change dramatically. So you name it, I think they're going to be a lot of impacts. And now what should you be doing? Well, I think a lot of experimentation may you probably want some production applications, but I wrote a piece last week about Morgan Stanley A big wealth management company is using it. They fine tuned trained on 100,000 of their documents and they're using it to provide their financial advisors with high quality answers to questions they have on what are the firm's analysts saying about particular investments from a recommendation standpoint, how best to do certain tasks like how do I establish an irrevocable trust for my grandchildren? What regulatory requirements have to be met in certain domains? So 100,000 documents is not that many. They have to be well curated to make sure that they're accurate and everything. But I think it's going to revolutionize what we used to call knowledge management, which was an early enthusiasm of mine, making it much, much easier to capture high quality organizational knowledge.
This is a very fascinating space you mentioned here. Really the breadth and depth of use cases that generative AI can unlock. In a lot of ways we're really still early if you want to compare this. Maybe the last technology that could this potential of change is maybe the invention of the iPhone for example, where you had a massive amount of software ecosystems that could have unlocked new type of application software. We're still really early days right now in the generative AI space, but maybe walk us through how you think the economy will be impacted in the next few years. I'm going to look at it from two different perspectives here. A lot of people tend to feel worry and anxiety when these types of tools come in as they can maybe displace jobs, disrupt jobs. And leaders as well are having to address create a vision for generative AI within the organization that incorporates the human side as well. What would be here your advice for professionals today that feel this worry and anxiety? And what would be your advice for leaders who are trying as well to communicate a vision that both incorporates humans and generative AI as part of the organizational strategy and future?
Well, I've been a pretty persistent advocate of augmentation over automation and I've written two books on the subject. One with 29 case studies of people whose work is augmented day to day called working with AI. Another a little bit more theoretical but with some examples back in 2016. And I didn't really suspect that large scale automation could be coming anytime soon. I'm less sure of that now with generative AI in content creation fields. It is just so amazingly productive and effective already. You say in the early days that I do have some concerns, but I think for now you're nuts if you take the output of generative AI and release it directly into the marketplace without lots of editing and trying out multiple prompts and so on. So there's still a human component at the beginning, at the end of generative AI process. I don't know. That will always be the case as it improves in capability, but right now that's true. So the most important thing you can do is start to use these tools as an individual and be more productive with them so that people can say, oh yeah, we're getting some value out of this. We didn't have to hire an additional copywriter because our existing copywriters were so productive in what they did. It's a recessionary climate in some economies now. We're already seeing a fair number of layoffs. You want to make yourself as valuable an employee as possible, so by all means tell your boss what you're doing. Where we're doing some. I'm doing some work with another guy on the whole idea of citizen development. And some people have used these citizen development tools even before generative AI. They've used them to hold down multiple remote jobs at once as they could be so much more productive that I do not recommend. I think it would, long run, be not a good strategy. So managers, senior managers should be saying, this is a very powerful tool. Let us know what you're doing. But we think it's going to be really critical to our future and we'd like you to experiment with it. And I think they should be forming communities of practice within the organization to say, what have we learned about what works, what doesn't work, which tools work best for us? Are there legal issues? Clearly you want to get your general counsel and your legal staff involved for things that go out into the world in terms of production. There's some, maybe some security issues, et cetera, some ethical issues. I talked to a fair amount about Unilever's approach to AI ethics in my all in on AI book. And I got a message from the woman who focuses on ethics primarily there yesterday, saying that they were quite focused on generative AI and what does that mean for their ethics approach? So. So I think there are going to be a lot of potential ethical issues around misinformation and deepfakes and the usual issues of transparency and bias and so on.
Yeah, I couldn't agree more. This is definitely an interesting, exciting, but also wary space in a lot of ways that I'm looking at. Maybe, Tom, to cap off our discussion. I know it's always annoying to put someone on the spot to give predictions, given how fast the generative AI space is moving. What would be your prediction for this space in 12 months from now?
Well, I think there will be generative AI front ends to almost every software product that we use. We've already seen some announcements of these for ABLO and HubSpot and Salesforce, CRM and so on. More and more companies are going to say command line interfaces or even point and click interfaces are going to be replaced by conversational interfaces. We're going to see finally, I think chatbots that are really quite useful. It's not going to happen overnight because they're going to have to be fine tuned, trained and going to be have to be on high quality customer service content which many companies haven't bothered to curate in the past. I think we'll see almost every online activity that we perform, search or social media or just, you know, Internet E commerce will be mediated by a conversational front end. I think we'll still have prompts, but I suspect within 12 months we'll have some alternative to prompts where a generative AI system would lead us into creating a prompt with a sort of intelligent front end as prompt creator. I think there will be many different customized models, fine tuned models, millions probably in 12 months. So I mean just think about in the legal profession there are already a couple of large language models trained for the legal field. But then you think about, okay, there are differences between US law, European law, UK law, so they're going to be versions for different countries or regions. There are going to be different versions for types of real estate law within those regions like real estate law. And even individual law firms will say, okay, Allen and over a UK firm, we're going to have the Allen Overy UK real estate law model that nobody else has. It's not exactly like ours. So there got to be lots and lots of these things. And no matter what we do you want to take a vacation in Peru? There will be a model custom design for where do you go, where do you stay, how do you spend your time in Peru?
That is very interesting and very fascinating. It's going to be a very interesting future in next 12 months and beyond. Finally, Thomas, do you have any final call to action or final words before we wrap up today's conversation?
Well, I think the time to move on these things is now. The Morgan Stanley people have been working with OpenAI now for 18 months and Deloitte has been working with OpenAI for 18 months on code generation. So there are some companies that are already ahead of yours in this regard. So you don't want to just sit back and wait for things to develop. It may be a hard thing to be a fast follower on. So start experimenting aggressively. Get your content in shape. This is in the generative AI space. In the AI space in general, I think you can start small because AI tends to be small, use cases, small level of functionality, individual tasks so far. But think big about what it's going to do for your organization and how it's going to transform it. So think big, but start small if you need to.
Okay. Thank you so much, Thomas, for coming on the podcast.
My pleasure. Thanks for having me.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra