#92 Democratizing Data in Large Enterprises
20 Jun 2022 · 43 min
Meenal Iyer, who spent 22 years building analytics platforms at Macy's and Tailored Brands, defines data democratization as "comfortable data access." The biggest obstacle isn't technology but culture: people resist change and cling to legacy tools. Data leaders need to act as change agents, not just technicians, building trust through quick wins like automating repetitive tasks.
Chapters
Hi, I'm Maggie, VP of Curriculum at datacamp, and I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy executives to cutting edge generative AI for developers, and everything in between. Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power your data and AI transformation journey on datacamp.com.
You're listening to Data Framed, a podcast by Data Camp. In this show, you'll hear all the latest trends and insights in data science. Whether you're just getting started in your data career or you're a data leader looking to scale data driven decisions in your organization, join us for in depth discussion discussions with data and analytics leaders at the forefront of the data revolution. Let's dive right in.
Hi everyone, this is Adele, Data Science educator and Evangelist at datacamp. If you've been listening to Dataframe for a while now, you probably know that data democratization is one of my favorite topics to discuss on the show. Every now and then I get to take a bird's eye view with guests and discuss the broad ways organizations can become data driven, and this is one of these episodes. Today's guest is Meenal Iyer. Minal is a data analytics strategist and transformational leader with over 22 years of experience building data analytics platforms and driving enterprises to be insights driven. She has a wealth of knowledge and specialties including data literacy programs, data monetization, enterprise data analytics strategies, amongst others. She's led data teams at various retail organizations such as Macy's, Tailored Brands and more, and she's one of the few data leaders I've spoken to that can really articulate a simple, coherent strategy for data democratization.
Throughout the episode, we talk about the.
Components of data democratization, data culture and people the importance of standardizing business metrics to achieve data democratization, which we spoke about at length, how to enlist data champions as analytics leader, and much more. If you've enjoyed this episode, make sure to rate, subscribe and comment, but only if you liked it. Also, don't forget this week we'll be hosting DataCamp Radar, our digital summit on 6-23-20. During the summit, a variety of experts, including Minal from different backgrounds, will be discussing everything related to the future of careers in data. Whether you're recruiting for data roles or Looking to build a career in data. There is definitely something for you. Seats are limited and registration is free, so secure your spot today on events.datacamp.com radar. The link is in the description. Now onto today's episode.
Binal, it's great to have you on the show.
Likewise, Adele, thank you so much for.
The opportunity to speak in this show.
I'm excited to deep dive with you on your work leading data Science and Tailored brands, the importance of data democratization and how data leaders can really create a vibrant data culture. But before, can you give us a bit of a background about yourself?
Absolutely.
So thanks again for letting me speak about data democratization.
It is one of my favorite topics to speak about.
So as terms of the background, I've.
Been in the space for about 20 years and have experienced the good, bad and ugly of the space worked across.
Multiple industries which gave me also the.
Experience to solve for unique data problems I enjoy or enabling data enterprises to.
Essentially become data driven. And that has kind of become my motto to provide the right information to the right people at the right time. I'm currently working at Tailored Brands. I head data science and experimentation here.
In addition to data and analytics.
That's really great. So you mentioned here, like data democratization is definitely the meat of today's conversation. I want to set the stage for today's chat by first unpacking what it means to democratize data. We've seen a lot of organizations investing tons of resources in becoming data driven. So I'd love to first start off the conversation to understand how you define data democratization.
If you ask me, I think I found the best definition is something from.
What Bernard Marr basically said. And what he said is, and I.
Quote, data democratization means that everybody has.
Access to data and there are node gatekeepers that create a bottleneck at the.
Gateway to the data.
And the goal is to have anybody.
Use data at any time to make.
Decisions with no barriers to access or understanding.
And so if I have to kind of rephrase this a little bit, I.
Would just say data democratization is not just about data access, but actually comfortable data access.
So you have a documented, ready to.
Use platform with tools and a culture that actually provides data driven decision making and data literacy.
So in addition to just telling everyone that oh, we have centralized all of.
Our data access, you actually need to.
Make that access very, very comfortable and.
Convenient so end users can use it.
To become more self service.
I love that concept of comfortable data access because I think a lot of people stop at just the data access component of it, which really hurts the ability for people to make data driven decisions at scale. So as you mentioned, there are definitely multiple components to democratizing data effectively. This can range from scaling data access and data infrastructure, centralizing data, having strong governed data as well culture and upskilling and a lot of different things that need to come together to be able to create a data driven organization. So I'd love it if you can walk us through the different ways organizations can accelerate data democratization.
Absolutely.
I hope you have a pen and.
Paper ready adele, because it's a list of items.
So I would first say that if.
The organization is just starting with data democratization, the first thing they need to have is an enterprise data strategy with a prioritized list of priorities as to what needs to be done in data itself. The reason why this is so key and so critical is the fact that this is a multi year journey and without the executive or enterprise support, it.
Is going to be almost impossible to.
Make this mission a success if we do not have this strategy in place. This is very, very key and very important. Before anyone even embarks, you have to.
Know what is it that you're setting.
Out to do and have basically your long term vision set out. Once you have your data strategy set out, you essentially start building out or thinking about a more forward looking architecture.
So why we say forward looking architecture.
Is that you have to at least look out three to five years in.
Terms of what your platform is going.
To be able to provide.
So you have your near term priorities, you have your strategic objectives for the organization.
Where do you see your organizations in terms of data over the next three to five years and that's what your architecture is going to turn out to be so that you are not continuously.
Doing migrations or not continuously trying to revisit this architecture.
And you are always in the process of building out and never at the point where the organization is fully self sufficient with their data needs. The third is so again we talk.
About where you try to reduce data silos within the organization. So that's one key part of data.
Democratization is to have access to the data within the organization itself. Now there may be some limitations to certain data which you may not want to bring into a central warehouse or a central data lake and that is okay. But for most part, 85 to 90% of the organization's data essentially would pipe into the system. And so you need a centralized data team who basically helps with the piping and who helps essentially with managing the access across this, the fourth is essentially data quality. Now this is very, very key and.
Very important to everything that you do.
You basically build data lineages and data.
Quality as part of your process as you are piping data in. Ensuring data quality will also give credibility.
In terms of what is being reported.
Out of your platform.
And also when you get to the point where this goes to executors, or when you start going into doing more.
Data science or building data models and machine learning, you know that your data.
Is not skewed and or biased.
You can always trust the quality of.
The data, so you trust the output of whatever is coming out of that data itself. The fifth one, and my most favorite, is the semantic layer. The semantic layer is very key just for the reason that that's the layer or the view that the end user has access to.
This is the view that they use.
To essentially consume the data that exists within your ecosystem.
When we talk about comfortable data access.
The semantic layer is the key to that comfortable data access because it tells your business users that, okay, you can basically query me without having to write.
Very complicated SQL or doing very complicated joins.
You have predefined metrics, you have predefined KPIs defined within that semantic layer. So there is no reason for the.
Organization to have confusion in terms of what is it that they're looking at.
Or what is it that they're pulling out. Sixth is.
So once you have this platform in.
Place, you meet regularly with your stakeholders.
And you tell them, okay, and at.
Every point in the journey, actually, you.
Have to meet with your stakeholders and.
Continue to update them on the status of what's going on. And at this point what you should.
Do is you have to be ready for some maybe reprioritization because these are organizational goals that you're trying to meet as part of the build out of this platform itself. So you may expect some shift in priorities here or some additional priorities which.
You have to account for. But the meeting with the stakeholders also ensures their continued support for this journey that you are on. Then you focus on basically the tools for the end users to use.
So these would be a standardized set.
Of tools that essentially meet again, the needs of almost 85 to 95% of your end user base.
There are going to be some end.
Users who are going to have very specific use cases and you have to think about how you want to address those.
But for the bulk of the organization.
Essentially you have to think about what are the standard tools that we have.
To provide to them. So, so that they are able to.
Get the most value out of this platform. And then you have data stewards essentially.
Identified for all of the data that.
Is coming into this platform. For each source of data that you're.
Bringing into this platform, you have data stewards identified.
So subject matter experts who essentially are able to help define or dictate as to what the rules of the data going from the system essentially coming as.
Now, these people also become your data.
Stewards for all your governance processes and privacy processes and everything as well. Then we talk about data privacy specifically to support CCPA and gdpr, for example. Customer data is very sensitive. You have HEPA rules in terms of healthcare data.
All of this is very, very key.
So the data stewards, essentially you work very closely with them to identify what's sensitive versus what's not sensitive and who can get access to what.
And then you work on data literacy.
Your platform is set up and you.
Basically want to improve and increase the adoption of it across the organization itself. So data literacy programs, where you provide.
Continuous training, where it ensures that adoption.
And it ensures the continued usage of the platform so that it continues to stay effective. And you have to continuously evaluate and.
Run statistics on the platform and understand.
If there are certain areas of your platform that are not being used. So you have added functionality, but then.
No one is actually using it.
And try to understand that how did.
This become a priority and not get used?
That is an exercise as a leader that you have to continually keep doing. And if you do these, and this.
Is like a small list of components.
Essentially that lead to data democratization, then.
You are, I wouldn't say guaranteed, but.
You are bound to move towards a successful implementation.
I love the clarity by which you approach the discussion here and how you position each element so concisely. Now, of course, out of all of these levers, there are so many things that we can unpack from governance infrastructure upskilling. Out of these different levers, what do you think is the most challenging and important lever to scale, and why is that the case?
So I think the most important one.
From my standpoint, and what has been the most challenging is the data culture.
And that comes to user adoption and literacy itself.
It's human nature, essentially. You know, you're very, you're very comfortable.
With what you work with and you're.
Comfortable with what you have access to.
It provides you so much security that.
You are the one who kind of.
Knows this stuff, and all of a.
Sudden you come up with something new which is going to basically automate and Then you're like, oh, my God, now.
70% of my time that I was.
Spending on doing my stuff has now.
Been reduced to 5%. What do I do? And that's, I think, the biggest challenge that organizations face.
And it's more so with legacy organizations, organizations where, you know, which have been.
In place much before, you know, technology came into play. So affecting data culture is, from my perspective, the most challenging and the most.
Important lever to scale.
That adoption is very, very key if.
You truly want to enable your enterprise.
To be data driven. So we have to make sure that.
The organization conforms to the guiding principles.
Of the platform regarding governance, privacy, the.
Consistency in key metrics that are being reported. And we probably can talk about enterprise.
Key enterprise metrics being consistent across the.
Organization at a later point. But, you know, all of those are.
Very, very key in them having to accept it just so that you can truly create a culture of where the.
Decisions that are made by data, again.
Are not skewed and are biased and.
Coming from a place where the data.
Cannot actually be trusted.
So I think changing the culture, from.
My perspective, has to be the most challenging.
Definitely. And it's all about change management and giving the ability of people to kind of dig for data for themselves and creating that mindset shift. As a data leader, how has a lack of data culture affected the adoption of some of the solutions that you've developed, even outside of creating a platform where people can do data for themselves, but as a solution for the data science that you adopt, and what are the ways that you've been able to battle through such adoption issues?
So the biggest barrier that comes from a lack of data culture is essentially the proliferation of data silos within the organization. You have data silos, you have reporting.
Silos, you have organizations where you have 15, 20, 30 reporting tools within the organization. You have don't even ask how many data architectures sitting over there.
Data is not in a singular place. Reporting is all over the place, and numbers are never matching. And then organizations struggle to say, okay, which is the number that I should look at? I'm setting a goal to basically say.
My sales has to increase by 10% next year. But which sales should I look at?
When you look at it, if there is a lack of that data culture or the lack of where you're not looking at a singular governed data set, then all of a sudden these kind.
Of problems become more rampant and they exist within organizations, and it's not uncommon to have. So you have increased total cost of.
Ownership because now you have so many of these self managed data and data sets and then no ability to control. So if you have sensitive data that.
Moves across the organization, you have no.
Ability to manage or control that. And with things like CCPA that comes in, it becomes so important that very sensitive data essentially has to be managed so closely so that if a customer comes and says I need to remove.
Access to this data, then you have to remove that data out of the system.
Then it's not easy to do if.
It'S all over the place and you have no way of identifying where it exists.
So I think that lack of data.
Culture does cause a lot of problems.
Some of them are tangible, some of them are not, and some of them are visible and some of them are not.
But it does, it causes a lot of issues.
How do we make data essentially a.
Priority in every conversation? With every initiative that takes place, we.
Start talking about what are the success metrics for that initiative and how are.
We going to measure it?
Because you cannot manage what you can't.
Measure and you have to be able to measure that.
So how do we bring data into that conversation? Now it may translate to saying that we truly don't have data needs, but it is important for the data person.
To data leader to essentially have a seat at the table so that what.
That will allow is that, okay, now you have a whole list of stakeholders who are sitting with you and telling.
Okay, this is the initiative that is coming up.
And then it allows for you to.
Have the conversation and say, okay, this is what it is going to touch, this is what it's going to impact.
Then for them to have a top down conversation where they cascade that information down to their, to their leaders and.
Then it goes down all the way to the bottom of the, of the enterprise itself.
Now the other thing you have to look at is also bottom up.
So the top down approach, sometimes it's.
Not very effective just for the reason that it's represented in a very different way. So to ensure that that message is.
Reached, you have to ensure that there.
Is also communication from bottom up.
You show value essentially from what is.
Coming out of your platform or what is going to get impacted and see that how you can essentially provide that value for their business unit and or team also. And so that needs to be something that you have to be continuously communicating to them.
So that's one of the ways in which you can ensure that that lack.
Of data culture does not exist within the organization. It of course happens in a piecemeal way in some organizations.
It's easy because they already know what they want in terms of data centralization or it exists. It's just that they want to truly democratize data.
So depending on where you are within the organization, there's a communication that you have to do either from top down or bottom up.
And that will help address the issues.
That basically come with that lack of data culture.
The communication is very key.
That's really great. And harping on the semantic layer that we discussed about and how it also empowers the data culture. I've seen you speak about this quite a bit, and we've mention this in our conversation so far, is the importance of standardizing business metrics to be able to galvanize a data culture. Do you mind further expanding into that and how it helps accelerate the data culture within organizations?
Absolutely. So let me give an example. In one of the organizations that I.
Was working with, there was a key metric that was in use within the organization and we had 13 different definitions of that metric. Thirteen, not one or two. We had 13 different definitions of that organization.
So you can imagine just what happened that when that metric actually got reported across and that was a metric that.
Was being used to compute to basically.
As part of our strategy to see that whether we were making progress in.
Our initiative or not.
So it was very, very important that that metric definition become consistent so that.
We know exactly what number we were starting from and what we were actually driving towards.
I talk about this so much because.
This again is something that is rampant across organizations.
Finance, for example, has their own definition. Marketing has their own definition. Sales has their own definition.
And then so do other business units having their own definitions of each metric.
So bringing all those stakeholders together and trying to basically understand as to, okay, we have all of these definitions, but as an organization, we all need to.
Kind of attached to one definition that we can term so that when we.
Are actually communicating it is we are.
All speaking as one, rather than speaking at six or seven different business units and not speaking six or seven different languages. So inconsistency in metrics essentially means where the metric is defined differently across different business units and is being used in different forms, but it is called the same thing.
And that leads to a lot of chaos. And it's very, very important that organizations essentially come to an alignment in terms.
Of how they truly want to define it.
That's really great and definitely a nightmare scenario when you have 13 different definitions of the same metric. So if you're an organization or a data leader looking at such a situation where There is a lot of messy definitions of metrics. How do you approach the journey of reaching consistency? What does it entail and what does that journey look like?
So what we do here is so first you start identifying what are the key metrics across your organization and we prioritize them. Think of it almost like a data journey for you. I wouldn't say it's a multi year.
Journey, but it is a journey to essentially get all of this aligned. So you need to first understand what.
Are the key metrics that are in use across the organization and specifically focus.
On metrics that are used across business units.
So if a single business unit has.
A metric that they use, that's not.
Of too much concern, just for the.
Reason that it's used just within that business unit.
But if there are metrics that are.
Used across business units, that's where the concern starts. And so you identify basically the list of those metrics. You sit in down with the stakeholders and begin a conversation.
Now, this is like the toughest part. I don't think the build out of the metric or anything is difficult, but.
It is this conversation where you have to get alignment in terms of metrics.
And the challenge with these conversations typically.
Have been is who's going to take ownership of this metric going forward.
So you land on a definition, but then who becomes that owner, who becomes.
Responsible for that metric.
So this conversation is very, very important.
And very, very key to basically have.
And you bring all of them together and you sit in and you tell them, okay, we have all of these, so let's come now up to an alignment.
Now, in this case, the data leader.
Essentially is the facilitator or the coordinator.
Of these conversations, but you essentially are waiting for the business to make that decision in terms of what is the definition that should be used forward. So you document and you take it.
Across to the stakeholders and say that.
This is what we have now.
Can you tell us that which is.
The one that should be used once.
They decide on that singular metric?
We say, okay, now who becomes the owner of that metric going forward?
So defining that data steward or the.
Owner of that metric, that person will.
Be responsible now for all communication for.
That metric going forward. So business changes the way we look.
At the way we pivot our business, or the way we look at our.
Customers, our product changes, for example, and the metric definition is likely to change. So this person then becomes responsible to say, you know what, just because of these changes that are happening going forward, this is what the metric definition is.
Going to look like, and that communication needs to be done. They need to get alignment from all.
The other stakeholders and say, okay, this is what it is going to be forward, going forward.
This person is also going to be.
Responsible for that definition in a business glossary.
So you have a business glossary within the organization.
So in some cases it's a fancy.
Business glossary, like it comes as part of your data governance tool. But it can be something as simple.
As a shared Excel document or a shared SharePoint site, or a shared Confluence document or something where that is all defined.
The definitions are put over there for.
The organization to basically see. In short, basically this person owns the metric end to end and then we.
Just go back, repeat this exercise until.
We cover all the KPIs and metrics that are in use within the organization.
As I said again, it's a journey, I wouldn't say necessarily it's multi year based on the size of the organization.
And based on the number of metrics that you have.
But till you identify and get to.
That point, you just go through till.
You cover all the metrics. Once you have all the definitions in.
Place, then the data leader essentially goes back to his or her team and then goes and has that metric in its definition put as a metric within the semantic layer. So again, this is why that semantic.
Layer is very, very important. So if I have something called financial.
Sales, then financial sales becomes a metric within my semantic layer. So whoever accesses it going forward will get the exact same value.
And would you consider this like a massive low hanging fruit that can really accelerate data culture, given that it's not a multi year journey, but it's something that just requires alignment, people sitting in a room. And this is one of the easiest way a data leader can make an impact in an organization.
Oh my God.
Yes. Yes. I think this is so key and.
So important and people fail to see that. You're absolutely right. I like that. I like the low hanging fruit.
Yes. This is something that can be so.
So easily achieved and can be done.
With just some very quick communication between.
Teams and someone just taking ownership of something so simple, something which they're already working with and they just take ownership of it.
So absolutely. I think this is something that is very key to bringing at least landing.
And bringing that data culture much, much.
Closer to what you are looking for.
That's really great. And I think this marks a really great segue to discuss kind of the role of the data leader and democratizing data. I think the past few years we've definitely seen the role of the data leader, whether that's a VP of analytics or Data science, a cdo, a Chief Data analytics officer, it evolved into much more of a culture steward and a change management steward rather than someone who just sets the data agenda of the data team. So how do you, how have you seen this evolution over the past few years and what do you think of the data leaders role in democratizing data today?
So I think that role has evolved in leaps and bounds.
So if you looked at traditional data.
Leadership, essentially the data leader was an order taker. So his or her responsibility was just pipe the data into the system and make it available to the end user. There was nothing beyond that.
You attach a reporting tool on top.
Of it and that's about it.
They were an afterthought, typically when initiatives.
Launched or projects launched. But over the past few years when.
People started saying oh my God, data is the new oil, data is your latest asset, and then everything is all data, data, data and people are like.
Going all completely crazy.
This role has now completely taken like 360 shift.
And now what has happened is that.
The data leader has a seat at.
The table and their responsibility now is just not building those data pipes.
But now they are actively responsible for changing the data culture within the organization, making sure that organization is data literate.
That data is being used very effectively across the organization. In words.
It's basically they're like they become an evangelizer of data and they have to.
Become that change agent which they originally traditionally were not. So now with basically just having a.
Role of where all you had to.
Do was pure data engineering, now you have become like a data strategist, your data transformers.
You have to think about how you're going to monetize data.
You have to think about, you have to pretty much think about everything from a data perspective. You have to see that and ensure that the value that the business thinks.
That they are going to get from.
The data, you have to prove and provide that value to the organization. So the role has completely shifted where.
The onus of all of this is now falling directly on the data leader.
So whoever is the data leader and who's sitting in the space has a great responsibility.
And I'm not saying that they were.
Not responsible before, it's just that a.
Heavy responsibility has now been placed on.
Them where they have to be so.
Visionary, so forward looking, in addition to.
Just being someone who can execute.
And what do you find are key guiding principles to succeed as a data leader in such a stressful as well as high pressure environment where you have to really decide on and drive the data strategy of the entirety of the organization.
If you think about guiding principles, I think one is communication is a big.
Big, big key, right?
So when the leader gets into this.
Role, he or she may or may not have access to what they need.
To do their task effectively. They have to go out, reach out and ensure that they fully understand what.
Is it that is the goal, if it's not something that they understand at this point.
And what you have to do also.
Is that you have to have, as.
I said, a strategy in place. That strategy would kind of help you.
Dictate as to what your next steps are going to be, what you are.
Actually going to do. So that strategy is very important, not only like a data strategy, but you.
Also have a forward looking technology strategy.
For your team and for your organization itself.
So communication, getting that executive support, having a strategy in place, essentially a lot of what we actually talked about in.
Terms of the components of data democratization.
Become also your principles for what you need to do to basically make your.
Life much, much easier. And communication holds a big place because you not only have to communicate to.
Your stakeholders continuously providing that value that.
They are looking for, but also to.
The folks who are your end users.
And continually telling them in training them and telling them about the value of the data as well, so that they adopt your platform. So I would think in terms of guiding principles, I would probably go back again to my components of data democratization.
And say that, okay, these are, this.
Is almost like a checklist for me and let me ensure that I'm going.
And performing each of these steps. This should help reduce that stress that data leaders now face. And then of course, you keep yourself very engaged with the industry, attend.
There are a lot of data and analytics conferences where thought leaders come.
They share their best practices, they share.
Their thoughts and challenges in terms of.
What'S going on, where they are challenged.
And hearing and listening to other people.
Going through the same journey essentially helps you. You know, you have buddies who are.
Who essentially are going through the same.
Journey as you and you learn a lot essentially coming out of those.
I can imagine. And you mentioned here communication being super key. Of course, a data leader cannot do it all by themselves. How do you choose your collaborator, collaborators when embarking on these large transformational projects? And what does successful collaboration look like in a constant context of these data transformation initiatives?
So I see collaboration happening in multiple forms.
So again, there is this whole piece.
Of where you have a Data strategy.
And you have priorities for your data itself. So in that case it becomes a little easier because your collaborators are kind.
Of already defined and you already know that they have strategic initiatives which tie to organizational goals and they become your partners very easily.
But if you are also building out, you are also looking to see that.
How can you, how can you bring more business into your platform? You basically reach out to a business unit.
So again, that's where communication becomes very important. You almost have to be, I wouldn't say like a know it all, but you have to be someone who's aware of things that are going on within the organization itself.
You reach out to business units and.
Say, you know what I've heard actually that you'll have this big initiative that you're embarking on and data may be.
A concern for you. Is there any way essentially that we can step in and help you out?
In some cases you are able to get this project funded, but in some cases it's almost like you have to.
Prove it as a proof of concept.
And once you prove it, then you have a collaborator for life. And that person also becomes your data champion and allows you to promote it.
So that's one kind of collaboration that you can do.
The second kind of collaboration that you.
Do is going and talking to the top folks.
You can go down to the bottom folks and you talk to them and sit down with them, understand what their.
Challenges are and you do a similar exercise in terms of how do we, how can I help you?
There is opportunity here, I see.
And how can I make this easy for you?
Go to them, reach out again, it may be funded, may not be funded. Again you do proof of value and again you win a data champion for life or you've been a collaborator for life. I have done this successfully across my.
Organization and I have seen that one.
Is not only that these data champions become my. It's like the train, the trainer kind of mode. They become my champions for across the organization. So there have been meetings where they sit in and I have not sat.
In and they speak to the capabilities.
Of my platform much better than I ever could. And so that becomes an automatic showcase for my platform without me having to say anything. So as I said, you find collaborators in many forms. You just have to be aware of.
What'S going on from a data standpoint around your organization. And you go reach out and you.
Just have to go with the attitude.
That'S possible that you're just going to.
Probably get pushed out or you may.
Not get funding but if there is.
Value, you know that has to be unlocked because sometimes people don't see the.
Value that has to be unlocked. But if you see that value to be unlocked, then you almost, you force take that thing and you say, okay.
You know what, let me prove it.
To you, there's no cost to you, I do it for you and you tell me whether this is not going to change your life.
And almost like 90 to 95% of.
The time it has changed.
I think that sees a lot of success.
And for me, if you ask me, that's the best way in which data.
Championing or collaborations with others have kind of democratized my data better within the organization.
That's really great. And I love this virtuous cycle model that you're proposing where you start off with a low hanging fruit. It creates more evangelism of the data, generates a lot more opportunities to do a lot more low hanging fruits. And it's like a cross pollination of data within the organization. Do you mind sharing, Sharing to a certain extent, successful low hanging fruits, projects that you've worked on that were able to create data champions. And how do you prioritize which projects to go after first in your data journey to be able to create this momentum and keep it going?
Yeah, I have a couple of use cases that I could actually share. So in this one organization of ours, we had this whole team of marketing.
Analysts essentially who were there. And one of those analysts essentially was spending 70% of his week on doing this repetitive task. So he was given an exercise and.
Spent 70% of his week doing all of this manually. Then again, he repeats that same thing 70% of the week because the parameters.
Have changed and, or shifted. And it's a challenge.
So you have this really intelligent individual.
Who is here and that person is.
Doing a manual task, spending 70% on his time on probably something that he.
Was not actually hired for originally.
There is so much more value he.
Can actually provide to the organization. So we reached out first to his.
Manager and then eventually to him and we said, okay, we can help support.
You and we can actually automate this whole function out for you.
And he looked a little worried and he's like, there's no way.
This is so complex. And everything we said, why don't you.
Just give us a chance and we.
Can show basically what you can actually do.
So it took us a good two.
And a half to three weeks to.
Basically get everything that he was doing manually automated. And then not only did we automate.
What he had to do.
But we also gave him the capability that tomorrow if he has to change.
Or shift the parameters or variables within that set, he can do that with just the click of a button.
He saved not only that 70% of.
The time, but just because he had.
All this additional time, he got to work on more fun stuff.
And he was so happy at the end of all of this that he.
Became like our champion for life.
He became our key mouthpiece in all meetings.
He would just keep saying, oh, if there's anything that you all want to.
Get done, this is the team who's going to do it for you.
My team's work was done because we were like, okay, we don't have to go and market ourselves anymore. We don't have to prove value anymore. We don't have to showcase anymore. We have someone who is going to do this automatically for us. It's so simple, right?
As you very nicely said, low hanging fruit. These are like low hanging fruit that.
You just have to go figure out again, you know where they exist and go take your opportunity and go after it.
In another organization I was working, there.
Was a very critical problem of where.
They were doing this computation of on hand inventory manually.
And it was at a very, very, very granular level. So there was so much, so much data to crunch that. And again, since they were doing it manually, they were able to manage it.
Only twice a year.
It's a very critical thing that needs to be done actually at a weekly level.
But one given just the size and.
Nature of the data and the fact that they had to do it manually just allowed them to do it twice a year. They could not do beyond that. Even that twice a year was like.
A nightmare for them. So again we intervened, we got into.
Play and they were a very, very, very skeptical team. Very skeptical.
And again we said free of charge.
We'Ll just go and prove it to you.
And then if it works, all you do is basically have this thing run on our system. Going forward we went, we built it.
In, into our new platform. Not only then did we save on resource efficiencies.
Now basically the process even ran weekly as it was originally desired. That was what the actual intent of that work was.
Again, freed up a lot of time and then they could actually focus on other things that were sitting on their plate, which they were not able to focus on because of this whole nightmarish.
Thing they were doing.
That Jeta Champion again became so happy that he worked with us to eliminate that data silo and the reporting tools.
His team was using. He said, you know what, we don't need this.
Your platform is the one that we want to start building everything on. So when it came to migrating everything from his tools and his platform on, he became that champion for his team.
He went and spoke to his leadership and said that this is what we.
Need to do and we need to.
Move out of this. So again, easy, low hanging fruit, something.
We can all get to and something easy to do as a leader. As a data leader, as I said, you have to be like a communicator and an evangelist.
And as long as you are able to get to the root of the problem and then figure a way to help fix it for them, you are going to be able to successfully ensure.
That your organization is using data in.
The right way and they adopt your platform, which essentially was just built for that purpose.
That's really great and I love these stories, especially when you showcase the enthusiasm that it created. Now as a data leader, you want to balance out between the low hanging fruit and the strategic long term projects and even the more technically demanding data science projects that require machine learning, highly complex algorithms and tools that only subject matter experts like data scientists, data engineers, machine learning engineers know how to master. How do you balance out that roadmap between short term and long term wins? And what are some of the exciting kind of long term projects that you've worked on as well?
Awesome.
So this is how I manage and this is specifically for me how I manage.
So the way I resource and the.
Way I think about it is 70%.
I work on strategic initiatives, 10% is.
Essentially AD hoc, where my low hanging.
Fruit falls and any other ad hoc needs and, or requests that just pop in and then 20% is technical debt.
Okay, so we do accumulate technical debt.
And stuff starts getting older and then.
How do we keep it always new and fresh. So that's how I do the breakdown. Now in some cases what happens is that just because of timelines, one becomes 90% and then the others just become a little lower. But overall, at an average, I maintain it like this.
70, 10, 20 percentages, just a little.
It just allows me to say, okay.
I have managed and we should be able to get all of these things done. And for me it has worked basically pretty effectively. Now in terms of use cases, there.
Are a lot of use cases that I exciting ones that I've actually worked on.
But one that I was very, extremely proud of, not to say I was.
Very excited about it, but I was.
Extremely, very proud of, was when in.
One of the organizations I worked with, where we migrated to the AWS cloud.
Redshift had basically just come out. I think it was about eight months old. So we were almost going to be close to.
They probably were all having beta customers.
And not production customers. And we were going to be one of the first ones going into like going into the AWS redshift. And the interesting thing was that my team had basically traditional data engineers, including myself.
So we hadn't had access to cloud.
Technologies and we hadn't done that. And I created a training plan with.
One and a half months. All of my team became like cloud.
I wouldn't say experts, but we became, we knew everything there was to know about the AWS cloud and we probably.
Could talk about that in a separate.
Session in terms of how we did that.
But I was so surprised at how my team just, they just all picked it up and in six weeks we were all ready. We built out the whole architecture, our whole architecture. And this was not only the batch architecture, we built a full streaming architecture in the cloud and we launched on time. Of course, there was a lot of money savings because we were migrating out.
Of a very expensive platform as well. And then of course aligning with the.
Broader technology strategy for the organization. And then in addition, what we were able to do is that we were able to build a fraud detection model.
On this platform which would actually run in near real time and then spit.
Out essentially back to the application.
It would spit out a score to say that whether this transactional was going.
To be fraudulent or not.
And that saved so much of the resources on the risk management team because otherwise risk was going through these things actually manually.
So our ability to basically be able to score the transactions and we had about a 92% accuracy, it made it all worthwhile.
So a lot of exciting use cases.
To be worked on. But this one I'm very particularly proud.
About, that is so nice. And as we end on such an inspirational note, talking about kind of the value of creating a training plan, do you have any final call to action? Minal, before we wrap up, I'll probably.
Repeat what I said when you asked me to define data democratization. Again, data democratization is more than just.
Bringing data all together into a central location. It's not only about solving data silos or centralizing data.
It has to be truly an interface.
That the user can become self serve.
It has to be an interface where the organization truly can say, yes, we are moving in a data driven fashion.
It has to be an interface in.
Which you provide comfort, you provide the.
Tools, you provide the access and then.
You provide all the processes, the backend.
Processes of governance and privacy and all.
Of that and help basically the organization succeed in becoming a data driven environment.
So I think for me in terms.
Of call to action, I tell all data leaders is that focus on what.
That end view for the customer should.
Look like rather than just focusing on piping data in and just bringing all.
That data into a central location.
Thank you so much Meenal for coming on the podcast. I really appreciate it.
Thank you so much Adele. Thank you for letting me speak.
You've been listening to Data Framed, a podcast by Data Camp. Keep connected with us by subscribing to the show in your favorite podcast player. Please give us a rating, leave a comment and share episodes you love that helps us keep delivering and insights into all things data. Thanks for listening. Until next time.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra