#227 DataFramed x Analytics On Fire: Riding the AI Hype Cycle with Mico Yuk, Co-Founder at Data Storytelling Academy
18 Jul 2024 · 57 min
Mico Yuk, co-founder of Data Storytelling Academy, discusses how generative AI should accelerate productivity rather than replace jobs, why data professionals need prompt engineering skills, and why storytelling and emotional intelligence still matter more than self-service analytics tools.
Chapters
Hi, I'm Maggie, VP of Curriculum at datacamp. And I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy executives to cutting edge generative AI for developers, and everything in between. Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power Your data and AI transformation journey on datacamp.com.
People who are smart are looking at AI as a productivity hack, and that's how I use it, right? So I'm not afraid about AI taking over my job or my roles or people's roles. I'm consistently telling our students and our teams, here's how to use AI to get back time.
Welcome to Data Framed. This is Richie now. Actually, it's not just Data Frame. Today's episode is a collaboration with the analytics on Fire podcast. Now, the hype around generative AI is only the tip of the iceberg. There are so many ideas being touted as the next big thing that it's difficult to keep up. More importantly, it's difficult to know which ideas will be the next ChatGPT and which will be the next NFT. Today, I'm chatting with Miko Yuck, host of the aforementioned analytics on Fire podcast to dissect the trends and separate the wheat from the chat. From data fabrics to decision intelligence to responsible AI, neither of us are shy about having an opinion. And beyond podcasting, Miko has two decades of experience in data. She's the community manager at acryldata and also has her own data training consultancy. So I am incredibly excited to chat about the latest data and AI trends with her. Welcome to Data Framed. Good to be chatting with you.
Yeah, no, excellent to be here. And what a fun prep session.
Excellent. So I wanted to kick off just by asking you about jobs, because it seems like there's two camps here. There's like, some people think AI is going to make us all more productive, and then we're going to live happily ever after. And some people think that AI is just going to steal our jobs. It's going to be better than humans at doing everything. So where do you fall into this spectrum?
So, first and foremost, I just need to be very transparent that even though I'm a millennial, I think ChatGPT is revolutionary. Case in point, in my recent doctor visit, I just Uploaded my test results, I asked questions, and then I sat a month later listen to my doctor tell me everything ChatGPT said. And then I also asked ChatGPT what to ask my doctor. And then I told it answer me and I asked my doctor those questions. So full transparency. Needless to say, I just put my life up in there. Every contract I have, my mortgage, I'm like, I got questions. So I might be a little bit different. A lot of millennials. But with that said, even though I do believe in AI, I really think that people who are smart are looking at AI as a productivity hack. And that's how I use it. Right? So I'm not afraid about AI taking over my job or my roles or people's roles. I'm consistently telling our students and our teams, here's how to use AI to get back time. The things that some of these things that you've been doing that have been taking days, hours, Things like what KPIs are very similar for your metrics or what's the best chart for this? Or how should I draft this story? Dude, AI. And it's not that you should get lazy. One of the fundamental things that I'm afraid with AI is that critical thinking is going to decline tremendously because you have this machine to think for you. But there's so much things that you could use AI as an accelerator for to do much more than you could have within an eight hour work day. I see it as an accelerator for those people who are willing to literally have sit down and think, what are the things that I'm doing that I'm not very good at? And what are things I'm spending time on that I could use some help on? I think if you make those lists in your job and you throw it into something like ChatGPT or one of these AI bots, you're going to realize that you can significantly reduce time, produce a better product, and then focus on the things that only you can do.
That's interesting. It seems like there's a different standard, like people, where it's like, I never have time for everything, there's always more that I could be doing. And then AI is something that's completely necessary to help you be more productive. But if you're already like, well, you know, I do my job and that takes me 40 hours a week and then I'm done and I don't need to think about it anymore, then maybe that's the sort of job where you're going to be more at risk.
Yeah. So you're going to be replaced.
Very blunt. You will be replaced.
Just be candid. So your days are numbered. If that is your mentality, you are already a dinosaur, you're agent on the company's tab and you're going to be replaced. So I don't have a candid way to put that. Like if you know, and hopefully if you're honestly, if you're toward retirement age and you're just, hey, I just need to live up my last three years, it's fine. But I think beyond two to three years, if you have that mentality, it's either time to find a new job, go to entrepreneurial route or do something else. Because you are literally going to be replaced and not even by a machine. You're going to be replaced by someone who's forward thinking and embraces new tech.
And so for people who are working in data, how do you think that generative AI or AI more broadly is going to be used? How is it going to change people's roles?
Oh my gosh. So I have to tell you a secret. One of the first certifications I had in college was SQL certification, Richie. And like I was bad, I was, I mean, in a good way. I could do SQL. I could fast forward to where I am right now without aging myself. I don't remember nothing but a iftank clause. Like I don't, I mean I'm an Excel guru at this point, right? So I've traded my SQL hat for Excel. I go into ChatGPT and I'm like, I need the SQL statement. And I said, and also here's what I want to do. And it just pops out, you know, like I go in and I'm like, python. Like I need to get this done. You see how I'm smiling? It just pops out. I go in and I go, I need this script and here's what I needed to do and I need this short. And explain to me why you're doing this because I don't understand what the hell you wrote. And it still comes out and it works. And so I think that with regards to data people, beyond code, I could tell people what I use it for and what I teach my students to use it for. We use it for everything from one of the common questions, for instance, that we get from companies is I specialize in, for instance, KPI and goals. A lot of times companies will say stuff like, hey, what are other KPIs or metrics companies are using? Hi, what are other companies or metrics? You know Like, I, like, I know it sounds lazy, but, like, anytime I get questions that require me going to Google, I just go to AI first. Anytime I am struggling with something and I feel like I'm stuck and I need an additional perspective, I go to AI first. So I think that from a data perspective, again, really take a look at the things that you're spending time on. I think that fundamentally our jobs are not just going to change in terms of productivity. But I've said this on a few different podcasts recently, and I said, if you're in a data field, you have to understand you're eventually going to become a professional AI prompt engineer. And what do I mean by that? We are going to head to the stage where users are going to be coming to you at all stages, whether you're a data engineer, data analyst, whatever profession you're in, and say, hey, my prompt isn't working. I'm not getting the right chart to develop. Like, you know what I mean? Like, they're going to be coming to you saying, what's wrong with my prompt? Because every data tool we have now has an AI button in it. And you better believe that users are going, oh, that's for me. I don't know what I'm doing, but I'm going to go in and try. And so I really think that to get ahead of that curve, data professionals themselves need to become prompt specialists. That's where I think this is heading.
That's interesting that you should be doing everything AI first, rather than like, I'm not going to write the code myself, I'm going to ask AI to do it and then maybe fix it. And then also you just got to be like, focusing on, like, how do I get the best results out of AI rather than how do I do the best work myself and then maybe get AI to augment it? So it's a kind of flipped approach.
I recommend both. If you're a do it yourself person, put the thought process into it. I have stuff that I do and I put my heart into it. I still go to AI and ask it. I go, give me some case studies. Take a look at this. What am I missing? Like, I ask it gap analysis questions. What perspective am I missing? Give me some studies like, is there a gap in my analysis? So even if you do a good body of work, I'm not recommending that. I'm saying that AI has access to so much data, it's a great sound bite. Now, the caveat to that is that AI lies a lot of people don't realize that. So if you're asking AI for quotes and stuff, it just fabricates stuff. So make sure you ask it to give you valid links. A lot of people, they are lawyers who are heading to jail for perjury because the AI fabricated cases. So just be very careful when you ask for quotes and stuff and say, tell me who said it and give me a link. Because AI does lie. But I have a question for you, Richie. Let me turn this over a little bit. I mean, data camp, you know, and I don't know if people who are listening know this. You guys have over 450 classes that are data AI analytics focused. You serve over 2500 organizations, 12 million students over nine years. I mean, you must be seeing a trend here, right? Tell me what you guys are seeing from a learning perspective with regards to generative AI. Like what are the kind of classes people are taking? Give some perspective there.
Yeah, absolutely. And there's two real sort of streams here for generative AI. So a lot of it is just people that want to know, how do I get started? How do I use ChatGPT, what projects can I use this for? Why should I even care about generative AI? So there's this very broad interest, like it's actually AIs become cool again. And so lots of people wanting to know the basics, getting that sort of fundamental AI literacy and the other streams people are trying to build things with generative AI. So this is where you start adding AI feature, generative AI features to other bits of software or maybe just trying to build something to help you do data analysis better. In this case, it's all about using APIs. So one thing that's been a kind of. Okay, yeah, so a side effect of this is like suddenly knowing how to use an API, like call an API from Python is a very popular essential skill.
Again, I love it. And so in a data professional realm, or any professional realm, who are you seeing us more inclined to take these courses?
Yeah, so it's interesting because it's all sort of data professionals are wanting to know a bit about generative AI. So the common roles, data analyst, data scientist, data engineer. But what we also see is interest from software engineers because quite often it's the software engineering teams that are having to build these AI features. They don't have a background in AI, so now software engineers need AI skills as well.
Now, do you think that data people need to be wary of the fact that software engineers are kind of intercepting and coming over? Because traditionally AI is like a Data thing. Right. But I mean, the software, right now, the software gravy train for funding is drying up a bit. So do you think that that's why they're coming over and saying, hey, we need to start to embrace this? Because it, because I noticed tons of money, VCs are pouring tons of money into AI?
Yeah, absolutely. So I think a lot of software, a lot of data professionals do need to be aware of this. One interesting trend is that data teams are now moving into engineering departments. So the data team's gonna lie under the chief technology officer, for example. So this is happening in, tend to be newer organizations that are doing this, but it's an interesting trend. And data science and software engineer, maybe those, maybe those two roles are kind of converging a little bit.
Converging a little bit, yeah, yeah.
So the one data job that is more safe from this is the data engineer. So you still need to have the right data pipelines in order to feed the generative AI.
So I have a controversial opinion on that. I think they're safe until we get over what I call a Dropbox error. So you remember Dropbox where it was like, I'm on premise. Like, no matter what you tell me, I'm not putting it in the cloud. I'm like, dude, the cloud is a box in somebody's in a building somewhere. Just to be clear, like it's still to some extent on premise. It's just that you've outsourced it. Okay, so anyways, you remember that era where it was like, I'm on premise, then I'm hybrid and then, oh shoot, Dropbox dropped the bomb and now it's okay to put everything in the cloud and everybody's going to the cloud. I almost feel like with AI it's kind of going through that honeymoon phase or that phase of like, well, you know, in data or data engineering, I should say of like, I know my stuff and data pipelines are important, but I think the minute they get the security right and companies are like, just dump the damn pipeline in there. Like, you know, or there's a secure way to attach it. I don't know if that's going to last.
Oh, so you think the data pipelines are going to be more automated then?
Absolutely. I think once the security element, like what happened with the cloud and the on premise era, I think once the security element is satisfied or they're happy with it, I think that that can be automated as well.
So what happens to data engineering roles then, do you think?
No, I don't think it's going away. I just think they'll become more efficient and be able to do more. They'll be able to work smarter. Right? Because again, you still need them to look at. This is the thing data people, when the outputs come out, we still have to make sense of it. There's a term called data informed. I know we're going to get into this. We still have to make sense of it. We still have to go back to prompts. If you use AI, and I use AI every day, literally, one of the things I do in the morning, I just talk to ChatGPT. I talk through things like, I don't know if, you know, there's a talking function. And I talk and my family is like, what are you doing? I'm like, I'm talking through this idea with ChatGPT. And she talks back to me. I put a woman voice. It's very comforting. And I talk to her and she thinks it through at me and Miko. This is how you'd approach this. And I'm like, well, tell me why this is how I'm thinking. So one of the things I think that is anybody uses AI knows that to get to a final state requires a series of refined prompts. And I think that even though you're gonna get output, mastering that refinement is gonna honestly be one of the most valuable skill sets coming out. And when I say prompts, whether it's coming from your mouth, your hands, soon it'll just be like, left to elon. We just be sitting on and thinking, to be honest, and it'll kind of bring it together. I still think human beings have to have an input or take what comes out and make sure it's correct.
That's interesting. I like the end game where it's just like you're thinking to an AI that's inside your head. That's very science fiction and also mildly terrifying. But I'm sure a few generations down, people, I'll be like, oh, yeah, it's totally normal. I'm thinking with my AI.
Yeah, well, I do it on my phone again, just talking. I do it at least three times a week on some core ideas that I'm thinking about. And I just go and pull the transcripts.
If all these jobs are changing, how do you think organizations need to change their approach to training their employees?
So first of all, I think they need to stop jumping on the hype train. I understand there's a lot of pressure from the top and you're going, everybody, we got to Learn AI. I mean, first let's just stop. Let's think. The first thing you should do is ask AI. Here are the profiles of all my teams and here are demands. How should I approach training? Step one, here's my budget. Give it a few parameters. I have a five person data team. I got a data scientist, a data analyst, da, da, da. Here are the core businesses we serve. Here is our budget. Here are the list of classes we have. How should we be approaching training based on the demands that are coming? I would literally let AI create my entire training plan.
I do like the idea that you should start with like, what do you actually need rather than just picking something because it sounds cool.
Exactly. That's why I said based on the needs. Right? Take the needs that you gathered from. I recommend doing post. I mean, I don't want to go back into like how we do this, but I did a podcast on this with the head of learning from LinkedIn with Steve. I did this a few weeks ago. And you know they have 2000 data AI analytics classes. And he said, poll your leadership, poll your end users. Get that data. And I was like, dump it into AI, Put the parameters of your team and say, how do I get my team from point A to point B with this amount of money or this amount of time and let it create a learning plan. That's my whole point about the thinking process. Like AI can accelerate.
I like that. So you're using AI to tell you what you need to learn about AI.
In some respects, 100% correct.
I think generative AI is only one of the many things that are being hyped and buzzy right now. Do you want to pick the next topic to talk about?
There's one that was very interesting that you brought up to me around decision intelligence. And again, Richie, we're like millennial post stage. And I have to tell you, right, there's some, when you sent me over, kind of like, here's the prep, there's some things that popped out to me and I was like, yep, I know data camp is having to, you know, because you guys, as a trade in facility, I know you guys are having to like deal with like the error of data mesh and data fabric and decision. And, you know, they're just words. And so I don't know if you feel like me, but I just kind of feel like I've heard these terms before.
Yeah, definitely. A lot of these things are new words for things that we've already encountered already. So I was like, decision intelligence is very reminiscent of data driven decision making.
A matter of fact, did you see the latest Harvard Review? I work a lot in the bookstore. Just because being surrounded by knowledge when you're working helps me. I just get a spark. I was in a magazine area yesterday in Barnes and Nobles and I picked up the Harvard Business Review. At the front of it, it says storytelling and good. It's a framework for good decision making.
Well.
Right. And I'm like, I was looking for buzzwords. I'm like, are they doing decision intelligence, decision support? Like, you know what I mean? So again, those of us who've been around for a little while, I know the younger kids are listening to this. I'm sorry, it's not the popular bubble. It's just that we have seen so many iterations of this. And that's why I always tell my students, I've trained over 20,000 students myself globally, focus on the foundations. This in your lifetime, decision intelligence is going to become something else. It'll become decision AI intelligence. Whatever it is, get the foundations right. And so I believe in decision intelligence and here's why. Back in my day, do you remember decision support?
Is it the same thing but different name, or is this something slightly different?
No. So if you think about the maturity of data, right, let's do the maturity cycle. Determine the maturity of data was take a data warehouse, right? First we had basically, oh my gosh, I hope I remember the whole maturity cycle. We had a lot of data. And the whole goal at a first level of maturity cycle was to get the data into one place. Step one. When we got it into one place, everybody said, wait a minute, this is not telling us anything. We just have a bunch of information. So the next question was, how do we learn from this information turned into what we call insight? Insight was defined by things like trends and these different elements. Then we were like, oh my gosh, insight. Like, what is valuable? That's when we moved over into what we call the wisdom cycle. And the reason I bring up the maturity curve is because I really feel that back in the day when all of these bi teams were tagging their tag name literally in signatures were like, this is decision support. We're at a place where people had so much information and so little insight by teams and data teams needed to be decision support. What I think has happened now is that as a lot of organizations are now crossing a barrier from having insight to wanting wisdom. And wisdom on a maturity cycle is defined as repeated insight that provides. So we have predictive data, right? In other words, it's not just telling me what's coming, it's actually helping me to understand how to prevent it or change the outcome. That's wisdom. It's insights that are trained that can change outcomes and produce results. And so if you look at companies that are striving to get there, I think we see the progression of BI and data teams and analytics teams that are no longer decision support departments. They now become a decision intelligence.
So I've heard the same sort of thing, but with different terminology. So I've heard this is the data information knowledge, wisdom pattern pyramid. And it's a similar idea where you start off with the data and you gradually build layers until you get to the point where you can actually do something useful and make a business decision right at the top. Actually, I have to say I do like the rebranding a bit. From data driven decision making to decision intelligence 100%. It's easier to say for a start. But also with data driven decision making, the whole point was most decisions are made with no use of data at all. It's just someone like having an idea and saying it. But then a lot of people like, well, you know, you shouldn't just use data to make a decision. You've got to think about, like what all your colleagues think. And the psychology, well, hold on.
That's being data informed, right? So on the data transformation cycle, a lot of companies went from being data driven because remember, remember the whole era of data literacy, which is still a wrong. And I know we're going to get into that. The whole era, data literacy was like, when people see data, do they even understand what they're seeing? And unfortunately, during a pandemic, we learn they don't. The pandemic highlighted to the world even how bad journalism was like some of the charts that came up from journalism, like news TV was like, some of them, I was like, I need to get some people. I got DMs saying, Nicole, maybe you should call this news station, look at this chart. And they knew better data. People were like, this is wrong. And so I think during the pandemic we learned that, hey, data interpretation and literacy is a lot lower than we would hope. But kind of getting back over to data driven, one of the things I think that became clearly evident is that being solely data driven is not enough. I think being data informed is important. But I have to be honest, I have a different angle. I don't know what the term for this is, but I think it's data driven, which is the data in its purest form combined with being data informed, which is knowledge, experience from human beings perspectives, actually combined with AI, which is what I call the infinite knowledge. Now I don't know what maturity that's going to be, but I actually think that that's the right combo to drive true decision intelligence. What do you think, Richie?
Yeah, absolutely. I like that. It's not just data, it's like it's all the rest of your organizational stuff as well. I think what you said makes a lot of sense. I think the tricky thing for me is how do you do this consistently? Because it's like sometimes you're like, okay, we've got a lot of data, we're going to put it into a process and make a really good decision. And sometimes it's like, oh well, you know, it's got to make a decision quick and we're going to rush through this. So do you have any advice for like how you do better decisions consistently?
I do. Sorry Richie, I told you about me putting up my blood test. I like transcripts. I do transcripts of meetings. I feed it all to AI and then I question the hell out of it until I understand what I need to get from the conversation. So for me personally, when I go into meetings and I actually am transparent about this, I tell people, hey, we pay for certain AI functions. I said, I'm taking this transcript, I'll remove names. And I actually put it up and I say, hey, this conversation happened around this topic. Here are the storyboards and visuals. I asked it a couple of core questions. Do a SWOT analysis. Where are the gaps? What decisions should we make? Give me different decisions based on risk levels. Who's going to be a proponent of which decisions and who's going to oppose it and why? So I keep saying like I think the way I use AI, just because I use it every day from everything from meal planning to date planning to I go to it and say, just help me. Because I always, you know what I feel and I've always had this about data. I feel like infinite knowledge is a tool, meaning that like ChatGPT has access to knowledge that I in my brain and lifetime will never be able to comprehend. And I try to use that infinite knowledge to validate and become smarter about what I'm doing. So that's my approach. I know that's not for everybody, but that's my approach to really understand the depth of a conversation because I'm a storyteller.
That's brilliant. I have to say I've only recently started using these sort of AI meeting recorder tools been a complete game changer. Like, I've had so many meetings where I've had a conversation and be like, oh, yeah, I know what's going on. Come back to it a couple of weeks later, not a clue what we talked about, but having just this record of, oh yeah, this is what happened. Automatic summary generated is definitely one of the most important tools you can use.
Same here for my podcast. And also one more thing that I love to do is when I upload videos, I like to ask it to read body language. Only because I myself, I'm fascinated with behavioral psychology, but I actually ask it to read body language. And I once. It gives me hints of like, this person was apprehensive on this. I DM people. I'm like, hey, Richie, I remember in a meeting, like, when we brought up this topic, you looked, it was like cringy, you know, just like, be sweet about it to some extent. And I'm like, I just wanted to make sure. Did you. How did you feel about that? Cause I just felt like I got a vibe and just break the ice, you know? And nine out of ten times, ChatGPT is right. It's like, well, Miko, I didn't want to say anything. And once I start hearing that, guys, I just keep saying, use this tool to make you smart. ChatGPT can read expressions, it could read tones. It can sense tension that we miss. Don't sleep on these tools.
Do your colleagues feel that they're being monitored somehow then? Because if they know that their body language is being monitored, are they going to start doing fake smiles at you just like, oh, yeah, that's a wonderful idea.
So keep in mind, I've been doing this for a living as a storyteller, so I did a lot of training on body language and stuff. So they know, like, I just, I read stuff. I'm very EQ driven, like, just reading what's not said. I just use ChatGPT to get smarter. So I don't think anybody who deals with me personally do it, but I personally recommend that it's a way to read the room, especially for EQ challenge people. And decision making is so critical. You have to understand the onset things in the room because typically the things that are not being said in decision making are the things that are going to drive the decision.
All right, so I want to go back to something you mentioned before. You mentioned the ideas of data meshes and data fabrics. So go on. Do you just want to talk me through? Because they're both Very hyped ideas, very closely related, but slightly different. So do you want to talk me through what they are and what the difference is?
Yeah. For this purpose, I actually went and looked at the Google definition because I think we should start at the top, Right. Specifically, people are reading this, they're like, oh, shoot, let me go look what it is. I'll read out for you. Okay. So according to Google, data fabric is an architecture that facilitates the end to end integration of various data pipelines and cloud environments through the use of intelligent and automated systems. So, Richie, let me ask you a question because you've been in the game for a while. What does this sound like in a previous lifetime?
Okay, so this is like you've got lots of different databases all over the place, and you feed everything into one central database. So it sounds like a data warehouse.
You know, Richie, for 400, like, I mean, it is, ladies and gents. It's not again, to be a Debbie donor here, but when you've been in the game for a while, welcome to, like, data warehouse with new tools, and rightfully so. You know, like data fabric. When I heard this, right, just my sense of humor, I was like, is it linen, 100% cotton or viscose? Right. I was like, data fabric, you know, but at the end of the day, basically, I feel like data warehouses were more static. There's a lot of challenges with etl, let's not forget. I think data fabric is shedding the ETL process to some extent. Right. It's bringing in this automation, bringing in these new tools that we have access to and automating something that basically kind of was the black hole of my generation. Data warehouses are known as a black hole. And why was it the black hole? I remember CIOs telling me data warehouses are where I put money in and nothing actually comes out.
That's a harsh interpretation of data warehouses. But yeah, I can see how that's going to have happened in a lot of organizations. You build this thing and then the value isn't immediately apparent.
Right. And I think data fabric, on the other hand, now that we have access to new tools, we have data engineering, which focuses primarily on data pipelines. I think the focus of the rebranding is the fact that we are able to actually overcome that very statement and challenge.
It seems like the pendulum swings backwards and forwards between you should centralize all your data. And then it's like, well, actually it's quite hard to govern and standardize everything. So maybe we'll do decentralized and then People worry. Well, I can't really IT fix find any of my data because I don't know which organization owns it. So I'm hoping a data fabric has got like the best of both worlds and hopefully not too many of the problems of either.
Well, let's talk about data mesh. The fun thing about data mesh, it's another like big data non it pipe dream, right? Like, am I lying, Richie? It's the non it pipe dream. It comes up at least once every three years. The last non IT pipe dream was the data lake. And do you remember the Forbes article that later said that 80% of data lakes and big data ponds and sand dunes or whatever they were called, failed?
Interesting. That's a scarily high statistic. 80% failed. Okay, cool.
Yeah, I presented on this on stage. Yeah, you remember, data lakes were the big hype. And then most people don't realize I did a whole podcast on this analytics on fire. It wasn't just data lakes. It went from data lakes to data ponds and data puddles. Did you know that there's a whole O'Reilly book on that?
Wait, what's a data puddle then? Is that a really small data lake?
I have a whole, I have a whole podcast on this. Like there's a whole book at O'Reilly that talks about data lakes. And I think I'm skipping one. Data ponds and data puddles. And essentially it's exactly what you're thinking. A data lake is big. Throw all the data in, let people access it. A data pond is a little bit smaller with a bit more control from an IT perspective. And data ponds are tiny, more focused data lakes, essentially, they're tinier that are more subject matter focused with access.
It sounds like someone's getting like very happy with the jargon there.
Yeah, let me. And I'm going to make sure I look it up because I know your listeners are probably like on Google right now feverishly typing in data ponds. I'm going to find that book for you. Go ahead and talk. I don't want to type on my computer, but I'm going to find a data pond book for you.
Okay. While you're searching for things, maybe it's worth talking about how the data mesh works. So in theory, this is supposed to be an idea of it's just a process. There's no actual technology involved. It's just each department owns their own data and then they set up some kind of agreement for how that data can be accessed by other teams. Which in principle sounds very sensible. It also sounds like an awful lot of work to set up just in terms of getting the processes right to do this. Do you have any sense of how organizations might actually be able to make that work?
Well, I go back to higher foundation, so I've been over the years, just a little bit of background for me. I was a top 1% consultant. I started out in New York, work with. My core focus was Fortune 500 companies globally. And so I've seen the experiments of both centralized and decentralized approach to data teams. Right. So centralized being we're going to bring everything into the data team and then we're going to let people access. I might have an analyst in the data team who's assigned to finance, assigned to marketing. You know, I kind of do this shared approach, but it's within. Then we started decentralized, which is, hey, data teams don't have enough hands. We have to share the wealth of data and ownership. We're going to empower super users across these different departments and get them involved and get them to own. So Data Mesh to me is a swing on that pendulum. And by the way, I seen both, both approaches succeed and fail. So I don't know if not to pop anybody's bubble again, but did you see the recent Gartner where they talked about Data Mesh hype being over and the failure rate of Data Mesh?
It's already over. Is it? No, I haven't seen this. Go and talk me through what's the failure rate.
Just. Just go on LinkedIn and look at Data Mesh dead or dying. I want to make sure I do not butcher this because I know this is sensitive and I do like Zamac a lot. So I'm just gonna go ahead and make sure I quote this correctly, but just type in Data Mesh is dead in Google. But let me get the Gartner study. It was done a few years ago. Innovation trigger. Is Data Mesh obsolete? So Gartner predicts that a data mesh concept would be obsolete before it plateaus. That was 2022.
Okay, interesting.
Right. And I wanted. There's a number behind it. So I am here trying to see if I can get the number, but I don't know if they cited. Exactly. Yeah, they have a whole diagram here and what they're saying is that it doesn't imply that the paradigm will be absolute, but it might be supplanted by a different approach before reaching full maturity. People in Gartner, right. I used to sit down with analysts from Gartner, Forrester, Bark all around the world because I was Considered to be an analyst, even though I wasn't because it didn't know what to do with me because I asked a lot of questions. I think that we've seen this before, I think Gartner has and I think what they're saying is if you decentralize and this again goes back to the IT free hope dream, if teams decentralized and they don't do it properly, it's simply going to fail. There's just no good way to put it. And the reason it's going to fail is you have three things that you can guarantee in our data life. You all going to love this. Richie, you always hear that like what are humans guaranteed? Right? Debt and taxes. I tell my data students, I said there's three things that data people are guaranteed. Excel, SQL and change. You're not going to get away from this. The reason I bring that up is that with decentralization, one of the things that I've seen and I appreciate what Data Mesh is trying to do is that decentralization works until it doesn't. So what does that mean? I gave it to the business. Now the department changes, people leave, the knowledge is gone. We didn't document stuff. All these things happen. And so thinking that you're outsourcing it and handing ownership back, the problem is that when it breaks, guess who owns it.
Go on. Is that going to be the data team?
Absolutely. That's the problem is that the minute it breaks, which it does a lot of times what I've seen is it comes right back into the data team. So I think that while Data mesh is powerful, I think that there has to be an approach where it's a shared or ownership to where whether changes happen internally on the human side to the data team or changes happen externally, there's a level of accountability and ability to transfer, do KT right, transfer ownership and be ready to adapt to that. I think if that change management is addressed, then these things can succeed. But until then, to me, unfortunately it's a pipe dream.
Yeah, I can certainly see how if you've got a very decentralized system, you're going to with different cultures across different parts of your organization, people problems. Yeah. And then you can end up with different data formats and styles across your organization and make it very hard to run cross team initiatives then.
And that's why I think AI is powerful once it can get security behind AI. If you have AI, simply consume in every meeting everything that you're doing. When someone leaves, you just question AI. I have Richie's every call, his thought, his emails, everything. I'm like, hey, Richie is no longer here. I got a couple questions about this data model. So why was this created? This dimension, what day was it created? Why was it triggered? Oh, hi Miko. It was triggered because he had this meeting with Joanne. She requested this and this was the outcome. And then she said she didn't want this. And by the way, here's the artifacts. So again, I go back to like, where does AI come in handy? I hate to say it, it's not human replacement. I think it's human knowledge sustainability. So that's one creative use of AI that could fill the gap. But as it stands, this experiment, the decentralization, it has been done before, it has succeeded with mixed results. And I think so that's why Gartner was trying to hype. And by the way, again, don't do it right now, but just go type In Google or LinkedIn data mesh is dead and judge for yourself.
Yeah, that's absolutely fascinating. And I like the idea of having like the ghost of employees past. Knowledge management's so hard.
It is. And you cannot force people to do it. IBM charges people millions of dollars just for the documentation portion of our project. I remember sitting down and thinking, this is nonsense. Years later, in my mid-30s, they came out early-30s and were like, documentation is dead. And I was like, yes, yes, because think about it, how many documentation? Nobody reads it. We can't even get people to finish reading emails that scroll on their phone. People do like this, they do two thumbs down. And after that they're like, oh, this is still going TikTok next. Am I lying?
TikTok is very persuasive in that way.
Yeah, but they just keep swiping, right? If it keeps going, far less documentation. Well, this isn't working. Make sure you open that word doc. That's like 50 pages long. Come on, man. The average attention span, Richie, is like three seconds.
Agreed. And it's always like, oh, we've got a meeting in an hour, here's a 50 page document you need to read. So I can certainly see how AI summarizing that document is essential at this point.
Yeah, absolutely.
So you mentioned something very funny earlier, that there are only three important things in life. Excel, SQL and change. Let's cover Excel because it's been around a long time. I think we both agree. Well, at least my opinion is that for any given data task, Excel is never the best tool. It's just you can do kind of anything in it and you're More of an. More of an Excel enthusiast?
Yes and no. But the numbers speak. Richie, let's turn this to you. How many users does Excel have today?
Oh, man. I would guess it's got to be a hundred million.
Richie, that was 10 years ago.
Really?
Okay, go on, one more try.
It's lower now, is it?
Or.
Oh, I'm going to say it's got a decrease in popularity in the last 10 years. I'll go 50 million.
It's almost a billion. What?
It's gone up?
Do you know, don't you realize that Excel is not on any bi quadrant? It's because it's galactic. Interesting, right? So it's 800 plus million users. Okay. Excel is basically the first level tool where you could do anything. And I don't want to lie, the other day I was pivot tabling myself. Like you're going to laugh about this. Complete side joke. For 10 years, I've talked about users that go to pivot table heaven and experience a dopamine release on, like, anything. I was in that heaven yesterday. Right. It's just powerful. When your pivot table works, your index matches work, the answer pops out, it's there, you feel glorious, you put a chart on it and boom. Okay, so let's. As you can see, the dopamine is reflective. Anyways, let's get back to that. So the reason why I think this is interesting. I'm going to turn this on you in a second. Is that back to that interview I did on my analytics on Fire podcast recently with the head of LinkedIn, learning content management for data AI analytics. I happened to ask him what's the number one skill set that is requested by recruiters and trained on. And he said, I know it's 2024 and you're not going to believe this because we couldn't believe it. Freaking Excel. Richie, Excel is back to. What I said about data people is not going away. But I think what's interesting is I asked you this question during prep for Data Camp. Right. So let's reflect back on Data Camp. So data camp, 450 classes, 12 million people have been trained over nine years. What are you seeing as one of the number one requested skill sets?
The largest audiences for Data Camp are people who are working in data analysis. In that case, it's SQL and then also data scientists, and then it's mixture of Python and SQL. So these things, they're not new technologies. They've been around a while. Python's been sort of more recently ascending to the crown. Most Popular language, but yeah, these are the technologies that are requested by almost everyone. The thing is that for data analysts is that you need some kind of business intelligence platform skills as well. Power BI is the most popular, but there are a lot of these things and it feels like most companies don't really care exactly which BI platform you have, just as long as you can make a dashboard.
Thank you for saying that. One of the things that I knew was going to go away years ago was you need to be a specialist. I'm like, of what? I remember this, this guy was a colleague in Australia and he said something to me one day because, you know, I teach storytelling and data visualization. He said to me, miko, the bar chart is the bar chart in every tool. He said, there's a line and there's bars. He said, the only difference is in one tool it takes three clicks, in another tool it takes one click. He said, basically there's a core set of charts for any visualization or report that doesn't change, it's just the number of clicks. And so I think the fundamental principle of people understanding, more importantly what charts are, how to use them, how to portray data, is way more important than a technical skill set.
Absolutely. Going back to your example with COVID it's like, yeah, you need to be able to understand a line plot. Is this trending upwards, is it downwards? Is there some kind of cyclical effect, all that kind of stuff. This is just a fundamental life skill, being able to interpret like plots.
Well, data literacy, right back to what we were saying, data literacy.
Absolutely. And yeah, I think it's something everybody needs to be able to do. Whereas on the business intelligence side. Well, yeah, knowing how to build a dashboard is brilliant because you don't want to have to wait for your data analysts or your data team to help you out. You can do it yourself. The dream of self service analytics is sort of realized now.
Well, again, self service analytics, which we didn't get into and won't get into, is another pipe dream, right? Listen, anytime people, and I am not even an IT person, right. I have a technical background, I'm a computer engineer by thing. But I noticed that again, every two to three years there is a non IT pipe dream and I just sit and wait for it to fail. I'm like, oh, self service, we're going to hand it to the business and go away until it breaks. And so I'm not trying to knock people's dreams. I know that data teams cannot keep up with the requests, but I think there has to be a different approach because all these rehashed approaches are not working. And that's where I think things like AI could come in. But as I know we're going off, I actually think the most successful, successful self service experiment that ever worked is Excel.
Yeah, you may be right there. Because pretty much everyone can use a spreadsheet. You can do simple analyses in there and so it sort of set the bar for that, like first line self service analytics.
I think the second most important experiment is the iPad.
Go on.
How so kids, you give kids that device. Nobody has to train a three year old on iPad. You come back and mommy, they're showing you stuff. You're like, wait, what? Do you have enough teeth to be talking? What are you doing? They don't have to talk, right?
That's true.
Yeah, I got to YouTube, I see the video I want and now I'm dancing. I can't even talk. I got two teeth in the front. So we've seen it succeed. But in data world, listen, I could get so deep into this. Data is emotional. One of the things I tell my data students before we start is I do this like Kumaya thing. I start my classes by saying, if you do not want to be in the hospitality and sales and marketing business, particularly the TLC business, get out of data. You know why? Data is an emotional transaction and you are a therapist. People get emotional about data and if you're in a visual part of it, which is where I spent my career, it is hyper emotional and scientifically proven to trigger areas of your brain, like your cortex, that drives people to do irrational things. Colors change, emotions, it's like music. So I don't want to get too deep into it, but I really implore people and say, listen, data is emotional. Make sure that you understand that that's what it is before you get into it. Because if you think you're just going to feed people data without a story, you're not going to put any energy and emotion behind it. You're not going to have to focus on how you craft what you're saying. You are going to be sitting in a corner for a long time and wonder why the data promotion train has passed you by.
Interesting. So I guess you're saying that you can't just show some stats there and be done. It's like you've got to build into that story. And so the story on the data can really trigger people's emotions. And that's how you get into having.
Some kind of impact which AI can help you with. So if you have a low eq, which is a number of data, people that have low EQs, emotional quotients, meaning their EI needs work, which you can work on. I was one of those people. I've worked on my EQ for. I get tested every couple of years. I, I've worked on it for over a decade now. Then I wish I had AI because I go back to AI, which is like, hey, I have all my stats. I know what I want to say for this meeting. Here's my audience. I got a VP of research, a VP of this. Help me craft this narrative. And AI can help you to do that and then you can practice it.
I think that's certainly something that's very common in the data world. People struggling with that sort of emotional interactions and understanding what other people want and, and what their desires are and things like that. So I'm actually curious to hear more about this emotional quotient training. How do you get better at this stuff?
So for people listening before I say it, so people are not intimidated. When I first did my testing, this is a cute short story. I was excited. So I have an amazing coach called G again. I interviewed G on my podcast. He met me. I was at a celebrity event, whatever. But he met me and we sat down and talked and he said, well, let me test your EQ is intimidating. Some of my scores may have indicated I was close to a sociopath. I was lacking in areas of empathy. I was lacking in areas of self awareness. There was basically areas where I just didn't care, partially because I was like a young person in New York where like walking on the streets with the construction workers being harassed, you learn not to care. But that's a different story. Richie, you live in New York, so you know, I started in New York, okay. So I think that affected me as a young person where I'm like, okay, I'm not being nice anymore. But either way, with the eq, when I learned that what was helpful is Jay was like, but we have a path for you to increase these scores that changed my life. The Mikoyuk that's here Today, that's on MSNBC, CNN, top 2% podcast, top keynote, Google MIT Meta. It changed my life. And so with the EQ testing, there's a book called Emotional Intelligence Test 2.0. It's been revised a couple of times. It is literally a bible. I recommend that you read that book and then you can seek out Jay or another professional who is been trained and certified to Test your eq, look at your scores, and work with someone like Jay, which I can happy to put the information to understand the path increase to eq. Because remember one thing that I remember, one of my mentors told me, and I appreciate this, I had two mentors, very intelligent. One dropped out of Harvard, the other one went to Brown. And I remember them telling me one day when I was working in New York there in Boston and Maine, they said, the person who knows how will always work for the person who knows why.
That's very interesting.
Yeah.
Yeah. So knowing why, that's your management role. Easy peasy. Okay.
Right. And so knowing that why, though, comes at a level of emotional intelligence. IQ is more tied a lot of time to the how, EQ and iq. And typically Harvard is on a study higher EQ is actually tied to the why, because on top of understanding why is being able to communicate it and then execute on it.
Nice. Okay, so sorry, rabbit hole.
I know. I love this topic.
It's a brilliant rabbit hole. And I think this is, like, a good idea for personal growth for a lot of the audience. Do you have any thoughts on, like, what are the soft skills important then related to that?
Absolutely. And it's not just my thoughts, Richie. I've interviewed. I'm heading toward podcast episode 97. My podcast is primarily focused on data leaders. And just through my own experience, I think there's a couple of things that data leaders ask and that I've seen through training. And I'd like you to also substantiate this to what is happening at data camp. Number one is being able to ask the right questions. Like, I cannot even. Go ahead.
I'll say. Yeah. It turns out, like, podcasting is good practice for this.
Yeah. Like, and it's not just asking random questions or questions you feel, but legitimately being able to sit down, read the room, and ask a simple question that opens up the door to the answers that you need. Because bad questions equal bad answers. And in our data world, it equals bad implementations. Okay. Data pipelines of dashboards. I mean, it just trickles down into garbage can stuff. And so I think, number one, asking the right questions, number two, I think is around storytelling. So the narrative, what we hear and what we see come together in our brain at different times, whether or not people realize this. Right. Like, when I was younger, I remember my dad made me learn how to speed read. The whole premise of speed reading is you put your finger on a page and your fingers move the speed of your eyes and your brain is catching up. But it doesn't miss anything. I don't know if you know about speed reading. You could read up to 600. You know about that, right? 600 pages a day. Yeah.
The idea is you, yeah, you can read a lot faster than you would normally.
Right. And you know how it works? You put your finger and it's literally your finger is doing this across the page. And basically what's happening is literally when you study it, your brain is actually moving at a different pace from your eyes, but you don't miss anything. So if you take the premise of speed reading, I was like 8 years old, my dad taught me that we take a premise of speed reading and you think of humans. When you have a narrative and you can, it's an experience. And so if you tap into understanding both the what people hear and what they see and you put those two mediums together, you can control any narrative. Being able to tell a story that not just drives decision making but it drives impact, I think is one of the most sought out skills. Because at the end of the day, as a data person, you are always selling something every time you walk into the room. If you're gathering requirements, you are selling the fact that you are trustworthy and can drive the discussion. If you're introducing a new tool, power bi. Whatever it is you are walking in and you're selling them to trust you to implement this tool with data that they're accountable for, that you're not going to be in the room when they have to answer those questions. For the ability to garner trust through the stories that you're telling is super valuable. So that's number two.
Absolutely. I like that. So storytelling and being able to gather trust. Yet I've also interviewed a lot of executives about this. I think I've only ever had three answers on what's the most important skill. One of them is communication skills, which I think very close to the storytelling idea. Secondly, collaboration, which is close to the sort of gathering trust idea. And the third one is ownership. Just having people be sure that you can go and do stuff without having to be watched over.
Confidence. It's the confidence, right? So even coming into the room, you know, I get into it because I coach executives as well and I talk about just how they present themselves and their voice. And so case on point, I could tell you, for instance, when I was on cnn, I remember this is a good story for everybody, right? So I wear my glasses because my eyesight decided they wanted to decrease. I came on cnn, I had a brilliant idea one day and this was my look. And I came on CNN like this. Now we have a 10 minute prep session and I remember literally being told, where are your glasses? I'm like, I'm good, I can see without them today. And they're like, no, you have a look. And your look is a smart data commentator who is helping America understand how to save and spend their money during the pandemic. Where are your glasses, Richie? I had to pull those. And mind you, I'm a data storytelling professional and put them on. You know what they said to me? You have a look that people have been married to and your glasses are a part of that. We're not changing course right now.
Interesting.
Very interesting. Right. And so I sit at all to say data people, just even consistency in how you present, how you speak, how you listen, how you watch people also being able to read the onset things in a room. There's the obvious things like this, right? What does this mean?
You check them down. That means we've been talking too long.
Exactly. And then what does this mean?
Yeah, so that means I've probably come up with a terrible idea and you're trying to find a polite way of saying no to me.
Correct. And so these are the obvious things. There's a book called you can read anyone. It was by the former head of the CIA. That book I've read 10 times. It's like a cheap $3 book because people who it was intended for don't need it. I want to give it out to every data person that exists. Like I think the onset skill that I would add to that two of them is being able to read a room and also curiosity. So I think one of the things that happens too as well is, you know, data people have two extremes. They either go down too many random rabbit holes or they don't go down enough. So I think striking a balance of where your curiosity serves your users is where you find data people that are super successful. So I think hopefully we covered the spectrum. But I think again going back to the eq, I know for me my journey is that once I got that checked, it's like I almost, you know, my, my coach, for me, it's like I checked in.
I like that. So is you're getting some data driven feedback in terms of are you improving?
Absolutely. And the feedback is detail. Right. There's scores and they basically analyze all of your results and then my coach interprets it and then there's a path that's created to say, here are the skills you're going to work on. And it is hard work, Richie, I have to tell you, like being in New York and having to care about construction workers and be more empathetic when I really want to tell them what I think because they're staring at my rear end. It takes a lot of empathy, but you have to make sure that you practice this on a daily basis and. And really just understanding that type of stuff and practicing it regularly. It's a skill set, but it works because it reflects in how you approach people.
This is like exhausting training, but also very rewarding if you can pull it off. Yeah. Being nice to construction workers. Well, I'm sure for any construction workers who are listening, yes, we should be nice to you as well.
New York construction workers. Richie, come on. I worked in Manhattan, you know. Come on. You know what I. You know what I'm talking about. They're not normal.
Yeah. I don't get wolf whistle very often, but I understand what you're talking about. All right, then. So before we wrap up, have you got any final advice for data?
People loving data is a start. Loving your users is more important.
Nice. Okay, back to the empathy. That's. That's very good.
Yeah.
All right.
You tend to find that if you love the users board, you love the data. It goes back to something that we all have heard, which is don't chase money, chase passion, and the money will follow. I feel like with data that if we truly invest in our users and we build that trust, that understanding we invest in ourselves, that the data skills on the end, all that technical work that we've done, can actually truly be realized. I don't think it's the other way around. Yeah.
Yeah. I think if you just start with let's do something cool data, you'll get somewhere, but you're not going to get all the way. So, yeah, I like the idea of care about your users and something good will happen. All right. Yeah. It's been a pleasure chatting with you, Miko.
This is so much fun. Yeah. And one more thing. Don't sleep on Gen AI. I know that we're not here to do hype cycle. I mean, me and Richie talked about that. We're going to be honest about it, but the reality is that it's coming. You don't need to think about a robot taking your job. Let's not get silly here. But at the end of the day, make sure that you understand it, because it's going to be one of those things where the users are going to show up at your department and you do not want to see at that point. Oh, we're figuring it out. You know what that equals? It equals a consulting firm. Not knocking my consultants but at the end of the day what users do when they hear stuff like we're figuring it out. We're just learning. We're in training. Is it go to Google and type in Genai specialist for financial department. And then.
Yeah. They've got the answer immediately.
Okay. And then they got the answer immediately. So don't sleep on it. Don't go crazy. Do again. I gave you guys steps on how to approach your learning. Just make sure that your answer is absolutely. I've already upscaled Mikko and Richie on it. A matter of fact they have a little sandbox going. Let's look at what you have. We absolutely could do it. Just be ready.
Excellent. Yeah. Scout's motto, be prepared. I like it. All right. Pleasure chatting.
This was fun. It.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra