#190 How Data Leaders Can Make Data Governance a Priority with Saurabh Gupta, Chief Strategy & Revenue Officer at The Modern Data Company
22 Mar 2024 · 42 min
Saurabh Gupta explains how to make data governance a priority by shifting quality checks earlier in the data lifecycle, from producers rather than waiting for consumer alerts. He outlines a four-pillar framework: people, process, policy, and technology. Start small with high-impact use cases, automate repeatable checks like software testing, and build data literacy through executive sponsorship.
Chapters
Hi, I'm Maggie, VP of Curriculum at datacamp, and I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy.
Executives to cutting edge generative AI for developers, and everything in between.
Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power your data and AI transformation journey on datacamp.com for Gen AI to work better, to deliver you better results, you need better data foundation and I think that is adding to the importance of how data should be managed, how data should be governed, what are the ethics around it, how data quality should be seen more and more? I would say this is just starting and a lot of tools have also started coming in. But I think more than the tools, the process part, the people part, the acceptance and understanding of the importance is the key.
Hello everyone. I'm Adele, Data evangelist and educator at datacamp. And if you're new here, Data Framed is a weekly podcast in which we explore how individuals and organizations can succeed with data and AI. There's this concept in software engineering called shifting left, which refers to an approach to testing software happening way earlier in the development lifecycle. This not only helps teams build better software development rituals and be more effective at delivering high quality software, it puts quality and usability of software as a key dimension to evaluate as you are building a piece of software. So taking that concept of shifting left, how do you apply it on data? Enter Saurabh Gupta, Chief Strategy and Revenue Officer at the modern data company and former data strategy and governance lead at ThoughtWorks. In this episode, Saurabh outlines how data teams and data leaders can start shifting left with data and embed Data Quality and usability is a key dimension to evaluate as data products are being built. I really enjoyed this conversation because shifting left really clicked for me and I have a hunch that this data product mindset will start creeping into the mainstream over the months to come. If you enjoyed this episode in this series, make sure to let us know in the comments on Social or More. And now onto today's episode. If you enjoyed this episode, make sure to let us know in the comments on Social or More. And now onto today's episode. So Rob Gupta, it's great to have you on the show.
Thank you Adele for having me over. It's very nice.
Likewise. So you lead the data strategy and governance practice at ThoughtWorks and I would like to set the stage for today's conversation given it's going to be quite a lot about data strategy strategy, data governance and the importance of the quality agenda. According to The Monte Carlo 2023 state of data Quality Survey, the time to resolve data quality incidents has increased in 2023 from 2022, and the percentage of company revenue reporting impacted by data quality issues has increased in 2023 over 2022. Survey is not necessarily fully reflective of the state of data governance today, but gives us a good idea of of where data quality efforts are at. So maybe with that in mind, I'd like to begin by looking at how you think the state of governance, data governance and quality is as we head into this new year. And where are we today when it comes to the state of data quality for organizations.
Adil, you touched a very, very sensitive topic or an important topic in the data industry. Data quality. The challenge with data quality is it's always pushed as far as possible to the consumer side. And as a data consumer, when I start looking at data and I realize it's not making sense, I start raising alerts. And this has been a practice ever since because most of the time when data was being consumed, it was in form of reports or charts or tables. One of the very, very emergent trends nowadays. And very useful directional shifters like move data quality and data checks as left as possible. And not only it sort of simplifies and improves the consumer experience with data, but also like multiple tracks in the way data is being consumed. It's no more just reports. People are using data in applications, different products, they use a lot of API based data exchange happening. So moving it data quality to the left I think is a very, very welcoming change that the industry is seeing. But that also means the data practitioners or data owners, data stewards, have to start looking at data early on and say, okay, what does data quality mean when I'm looking at this data and here comes the role of data governance and why I'm bringing data governance into quality. Discussion is, I think more than the quality aspect, the standards around data quality, the behavioral aspect, the checks and balances, I think have to be defined. The policy side of it is what data governance brings into play. Like across the industry we have been seeing the shift where data quality is becoming a cost prohibitive. Every time there's a problem, there's an issue with data, it circles back all the way to the source. And not only is the cost in Terms of fixing the data, redoing the reports, redoing the messaging, but also the opportunity cost it comes with it. So more and more practitioners have started looking at how data governance can play a role with a specific focus on data quality. And everything doesn't need to be in one shot, like it's a behavioral change. Right? So how do we start small, build incrementally in a way that everyone in the process, from data engineers, data developers, data analysts, the data consumers, they start seeing profit.
That's great. And there's tons to unpack. In what you said here, you know, you mentioned how data quality efforts and data quality and data governance has relatively been relegated in the past to the data consumer.
Right.
Data consumer spots issues, they raise alerts, and by that time it's already a bit too late because the problem has already started. Right. And then you mentioned, as well as an antidote for that is shifting left, which is something that is very, very interesting as this emerging concept. As you mentioned before we talk about what shifting left is, I want to talk about kind of the reason why data quality efforts have been a bit sidelined as less strategic potentially over the past few years. Right. I think there is a widespread recognition within the data community of how important data governance is. However, you know, often organizations view data governance efforts as overheads, right? Maybe not a strategic program or project. Unpack that perception for us and why it has been the case over the past few years.
I see data quality in two levels. One is very, very specific, saying, okay, this is black and white, whether this is right or wrong. But there are occasions where data quality can be very much specific to a use case, how the data is being consumed. And I can give you an example. So take for example pizza company, they want to report their quarterly sales of pisa. It has to be perfect. It has all checks and balances have to met. But the chief operating officer of this pizza company wants to track on a daily basis or which particular outlet is selling more pizza versus which is having a slack and wants to understand more focus on where the slack is and why it is happening. And that doesn't need to be a perfect data, it just, it could be. It may not need to meet the highest level of quality standard. But as far as the chief operating officer desk gets a report early in the morning saying these are the 40 joints out of the 400 you have are not meeting the usual sales they have. And I think that's a very, very useful data point. If you see from the chief operating office's point of View that he or she is looking into, okay, where I need to take action or immediate action. So data quality becomes important, but not the most. So I think consumers drive the definition of what data quality is. And one of the reasons why there has been the data quality has always been neglected because the connect between the data producers and data consumer has been missing. And as we start talking about the new concepts like data products, data mesh, the ownership of data is being identified. And as a role the data owner is also responsible or a data product owner is responsible to bring the quality standards from a consumer point of view he or she is supposed to bring is going to be the glue or the conduit between data consumers and data producers. And I think more we are seeing this, the better the quality is going to get better other issue adel what we have seen always, it's always been the case like as the volumes of data keep increasing, the push from the consumer side is always give me data, give me data. And a lot of times, like a lot of organizations are not using the modern data tools, data platforms, modern practices around data. So typically what happens is every time a new data set needs to be brought in, a new transformation needs to be done and someone is writing code. So the whole focus on left hand side becomes get the data, write the code, write the transformation and turn it into a data set or a report which can be consumed. And I think that shift is needed and it's happening like as the senior level executives have started using data as a rubric for their decision making. I think the quality aspects are getting highlighted more and more.
Okay, there's a lot to unpack in what you mentioned here, but I want to go back in what you mentioned on shifting left and why that matters. So we talked about a reason for why data governance efforts and data quality has not necessarily progressed. Quite a lot is the disconnect between data consumers and data producers. That's a very fascinating insights that I'd love to focus on. But maybe first walk us through what shifting left means and why it matters in the context of data quality.
So if you see right, like I'll just draw a simple data lifecycle picture for you. You start with systems are producing data. These are transactional systems. It can be hr, financial logistics, supply chain. From here data goes into the data is extracted and brought into a data lake or a data warehouse. And from there people are using this data to build their own reports or their own outlooks. Now most of the challenge around data quality gets highlighted when people start using the data I'll give you an example that there's a data being collected like World bank or imf, they collect data from countries, they're collecting GDP data, they're collecting population data. Population data is coming from one agency, GDP is coming from another. And an economist is calculating GDP per capita. So nothing but GDP divided by the population. Now if you see like the population data is intact, GDP data is intact. But the GDP per capita data, when they calculate the area is oh, something is wrong with that. Now that check that happened on the consumer side, on the economist side, who's looking into writing a policy report is way too late. It had the same thing happened in the beginning when the data is being brought into the system, I think it would have been a big, big, big advantage. So that's what I mean by shifting left. So from move it from the consumer side, start moving some of these data quality related efforts to the producer side. Now it sounds very simple to do it, but what it also means is like on the data producer side, someone has to start understanding how this data is being used on the consumer side. So take for example like GDP data is such an important data to track whether the how the countries are performing right now. As a check the data producer side, I can put a check saying if this debar is missing, give me an alert. Fine. In place of 100 billion, someone typed in 10 billion. So it will passes through the checkpoint, but the number is wrong. GDP cannot move from 100 billion to 10 and then move to 120 the next year.
Right.
But this gets highlighted after all the transformations, 15 different places people are using it, it goes to say 10 different consumers, an economist publication, it goes to a newspaper and that's when they find out, wow, this is wrong, something is going wrong. All these 10 consumers start reporting it to this agency and then they go back, back, back. I think it loses a lot of time, a lot of loss also, right? On the contrary, like if this quality check was that whenever GDP increases more than 5%, there is something wrong. That check could have been done in the producer side, it wouldn't have happened. I think long story short, what is really needed is bringing awareness around what data quality is and what bad quality means in terms of time, effort, opportunity losses on the producer side will help coming up with these checks. I think this requires also a collaboration between data producers and consumers to start talking about how do you bring some of these common checks and standards into data quality.
That's really great. And I want to double down on that because you alluded to this earlier on how the disconnect between data consumers and data producers is leading to a lot of dissatisfactory results when it comes to data quality and how shifting left here can be a solution to it. Walk us through in a bit more detail the operational requirements for a successful shift left program and what is a healthy relationship between a data consumer and data producer look like in this paradigm.
So there's a new emergent role in the industry, in the data industry. I won't call it very new, but it is still new. And a lot of organizations are still trying to frame and see how they can take advantage of this. It's called a data product owner. Now I think first we have to see is not see data as a data set. We should start looking at data as a product. What it means is like bring a product thinking around how data is being managed. And when we say product thinking, the immediate reaction should be is okay, I should know how this data is being used. Now how do we bring like if you see data producers, it's a very different role versus data consumers because data producers are more on the transactional side. Their focus has will always be how to get the operational gears turning all the time consistently. Now they produce this data, they turn it into a. These are extracted into data lakes, data warehouses and consumers are seeing it in okay, I'm using this data, it doesn't make sense. Now this role of a data product manager is something which is interesting because he or she is responsible for bridging the gap between how data is what is getting produced and how it is getting used. So if a data product manager is responsible for understanding the use cases along with the use cases, what are the quality aspects that come with it, what are the transformational aspects come with it. And by transformational is like if there are some calculations which a data consumer is doing every time, probably that also could be moved left so that how the matrix behind that calculation can also be standardized. And that's where I think some of the policies and processes which are governed by a data governance program comes into play. So if someone is building a data product, how what they do, how it is getting used, can any of these things be standardized? Should be the responsibility of data product manager, the data steward. And he or she will be responsible for getting those implemented. On the left side, when I say is at the point of data extraction from the transactional systems, all those checks and balances, the calculations, the transformations, if they are put there, then as the data flows through the pipe all the way to the consumer, the quality will be better, calculations will be consistent. And as the data gets some used or shared through different channels, whether it's a tableau dashboard or a Power BI dashboard or a API, it remains consistent.
I love that analogy or like kind of that role that you're discussing as a data. As a product manager, right? Because here we're looking at if you want to do the analogy of a regular product manager who's in charge of like a digital product. The product manager guides the developers, software engineers. So here, data producers to make sure that they're creating the best responsible features for users of that product, which is here the data consumer. So very great analogy here and how that fits into that role. You mentioned how this connects to the data governance program. In this case, who owns the data governance program and does the data product manager take inspiration for it's already there. Or walk me through kind of that interlock and how it works.
The data governance program I think is best if it's kept a little separate, but. But it's a parallel track because data governance program typically people talk about people, process and technology. I love to add another one, people, process, policy and technology. And the reason I want to bring in the policy element into the mix is because people and process is fine, but the policies are the one which remain. People change, the processes can change, but the policies are the ones which talk about standards, common calculations, they remain. So with that said, what I have seen successfully working in most of the organizations to have a centralized role and there are different models, there can be centralized, hybrid, it could be decentralized, it depends on the size of the organization, but importance of a particular role. Who owns the data governance program, what he and she is going to be responsible for is building or managing a framework for data governance along with the policies. The whole nine yards around data governance from a process point of view. Now any data initiative that kicks in that particular team will have to have this person with an oversight responsibility. And with oversight, what it comes is like say if someone defines like I'm building a new data product for this purpose. So as a data governance person, I should be able to say, is it discoverable, is it actionable, is it secure, etc. So all the checks, when we talk, if the quality being checked, if it is checked, what are the standards being followed, when the data is going to be published in a catalog, are there common metadata standards being followed? So all the aspects of turning data product into actionable, secure, governed, is my responsibility at a governance person. But it's not that I'm going to do it. But what I do is I work with the data products team or the data engineers team to make sure we bring this into the core development process so that some of the actionables could be automated. It could become a part of the thinking process from the very beginning. So the message which I'm trying to say here is bring data governance into action from the very onset rather than an afterthought. So when you bring it in from the very onset, then some of the capabilities to add are much simpler than going back and doing it.
You know, for organizations that don't necessarily have that shift left mentality, and I think there's probably a lot of data governance leads listening in right now being like, I wish we can shift left within my organization, maybe. What would be your advice for how to kickstart that shift left mentality and how to approach it?
It's a very good question, Adil. And this is one area which all organizations are struggling with because as a user of data, as a producer of data, I want to just produce, I want to just use, I don't want anything that slows me down in the process of doing it. So one thing which I've been suggesting for several years, and I've been practicing myself, is in an organization which has mature data use, data consumption, but the data governance is not as mature. Work closely with the data consumers and understand and sort of in a way document some of the challenges and pains they have. Turn it into a cost that the organization is occurring or the opportunity cost an organization is facing because of this issue. Now, it's very easy to say, but I think it requires time, it requires energy, and it requires a partner in crime on the consumer side, business side, who's ready to do that. So I think if done that, I think the opportunity becomes much, much, much easier or the problem becomes easier to solve. So a data governance role should be seen as a collaborator rather than a enforcer. And I think that's one shift which everyone should do. A lot of data governance practitioners face this issue that there's already a train in motion, how do we do it? And again, my two cents is going to be start small. And it's important to start small because if you try to make a lot of change which impacts a lot of people, then we push back, start small, establish success and partner with other person to jointly demonstrate it across the organization. While you do that, support from executive leadership is also going to come into play.
Yeah, it's definitely useful to always have executive Leadership support. But you know, what you're talking about here actually segues really perfectly to my next question because I wanted to shift gears a bit and discuss what are the key tenets of a successful data governance programs. You mentioned people, policy, process and tech. Right. And you also mentioned here the importance of starting small and kind of scaling from there and not try to push a moving train off of its tracks. Right. And be a collaborator as a data governance program manager. Maybe. First walk us through what you think are the key successful dimensions of a successful data governance program and what does it mean to operationalize successful data governance from a people, policy, process and tech perspective.
The core tenants you mentioned. For me it's always people, process, policy and technology. The reason I always put technology on the last is I think that's the easiest problem to solve. People is the hardest because it not only touches on their day to day way of doing things, but also a lot to do with learning behavioral aspects around that. So people is most important. So awareness, data literacy becomes a part of this whole process. So people aspects very important. Skills are important, awareness is important. Get them. Making them aware of how challenges around data is impacting the organization or good practices are going to help better deliver value for the organization. I think those are the aspects which need to. There's always a fear around change. So how do you bring a smooth change management around that's important to bring people along? So that's one. I think the second part comes in processes. Processes over time get very, very convoluted. I have a certain way of doing things, I did it. Then someone else comes in and he or she thinks oh, this change has. This process needs to be adjusted to meet a specific other name band aids. So over years band aids after band aids have been put in and that which I have seen in a particular organization where reports go out and then someone does a quality check on data because someone from the top leadership said how data quality is important. So then before even understanding the role of data quality, consumers receive the data, then the data quality. So I think this is like what happens is when organically processes are sort of changed, adjusted to meet either ask from the top or there's a need for adjustment. So I think simplification of processes are very important. Try with three steps, processes to five. But the moment you go to seven steps, something is wrong, go back and check. So simplification of process is very important. I would call it. The policy aspects are again like how to look at data, how to look at data processes, how to look at people. Like, in terms of data literacy awareness, what are the policies around it? Can these policies be phrased in single sentences which can be easily understood and applied? So I can give you an example. Like data quality rules have to be enforced or implemented on the producer side. Very simple sentence. Then it can be sort of detailed into what it means. It could be very specific to a data product. Now, if this as a policy is understood well, then what happens is like as a data product team or a data product manager, when I start building my data product, I go to that policy and say, okay, what does data quality mean for my data set? And I define, okay, these are the ways this framework says when you look at data quality, these are the parameters you need to check. And look at those parameters and say in context of the data product I am building, these are the ones which make sense. And let's apply. So what happens is policy gets abstracted at an organization level, but gets implemented at a process or a data product level. And what it also does is it creates check and balance that before the data product goes live, someone is going to check. And if it's not implemented well, there's a rework needed. Another example could be is like say when a data product is getting published in a data catalog, These are the 15 metadata fields it should have. What is the purpose, what is the frequency of updates, who is the owner, et cetera, et cetera, et cetera. Now, if I build a data product in which of these 50, only five are published, it should not be even published. This is where the policy is, the one which puts a check on that.
Yeah, and a lot of ways what you're discussing is really similar to how software teams approach unit testing and continuous integration and continuous delivery, but applying that mindset to data at its heart. So maybe you want to expand a bit more on that simile and kind of that metaphor and how it applies in a bit more detail.
Anything which is repeated, anything which is done over and over again, I think there's an opportunity to automate. So if you see from a software development point of view, a lot of small pieces are built together, they are tested and they are put together. So it's unit testing versus integration testing and overall testing. So I think in the same way, data products, when I'm being built, there are multiple pieces to it. The data injection pipe, the transformation routine, data quality checks, the metadata along with that and publishing, I think all these can be done individually, but when they are being published, there should be a check to do that. And I Strongly believe that if there are standards in place, a lot of it can be automated. What it means is like then it becomes less of an overhead but more of a best practice in place which is happening. I'll give you one very interesting example which used to just annoy me a lot. What people will do is like they'll take the data in an Excel sheet and they'll eyeball it to figure it out where the problem is. Still people do that. Okay. Now the challenge with doing that is I may catch it, I may not catch it and it can go. But on the contrary, looking at a thousand row Excel sheet, if automatically as a part of the process three rows are highlighted, then these have problems. It simplifies the problem a lot. Right. In place of looking at hundreds of Excel sheets, thousands of rows in each, I'm looking at three Excel sheets with two rows that have problem. Very simple. I think once you establish this as automated process, credible tested, I think everyone would love to use it. But till you don't establish, I think there's a problem.
Yeah, and you can, you know, once you scale that out to hundreds if not thousands of data pipelines, you can really see the potential benefit of establishing these best practices and processes. Now you mentioned Saurabh as well like that people is definitely the hardest element to crack in this framework. Right. Of people policy, process and technology. Couldn't agree more. Like the data frame is really big on the people agenda when it comes to data. So maybe walk us through some best practices that you found when it comes to moving the needle on the people component and totally appreciate that moving the needle here takes months and a year plus years here rather than weeks. So maybe walk us through what you've seen works really well when it comes to shifting minds on the strategic value of data within the organization.
I think the people element, Adele has few triggers. One is the urgency and urgency and importance. I would call it number one. That's the one which has to be created top down. Like when senior leaders in an organization, they start talking about this, they start demonstrating how they are using these as a part of their day to day jobs. I think it's it gets easier for adoption. So we can call it executive sponsorship, buy in from executive leaders and having sort of making it a part of your day to day conversation. Communication becomes a very important. So the moment this happens, so first ownership shifts. Second is it becomes a part of the communication now as a part of the oral organization, when people keep seeing or hearing this more and more it starts triggering okay, what's happening, why this is becoming important now in one particular organization, like the CEO in a board meeting will never accept any data unless it is substantiated by some data set in the organization. So no one can say that this is what is happening. Is there a data point? So I think when data becomes a part of communication, the awareness automatically starts building. So now this is from the top down. Now let's see from the bottoms up. Data has been always managed by experts, be it data engineers, be it data scientists. On the contrary, data consumers in many organizations or most of the organizations are still consumers of Excel sheets or reports. So there's a little bit of a fear like if you ship these reports from Excel to a self serve, it requires a skill and try understand how to use this data, how to use it too. So I think we need to make that process very smooth. There has to be awareness built, the importance, the need and also training programs around that. This is how you shift how you use data. Once you do that, I think still there's a resistance, there's a fear. But we need to figure out like who are the early adopters, get them into action and in place of the team who's driving change. The early adopters, when they start talking to their peers, they start sharing it, then it becomes a much easier thing. And I would say like there's always the last 10% late adopters, they will come, they'll have to be tracked along, they'll come. In one particular organization which I was working with, there was a very interesting practice that every time a new data product or a data initiative is completed, the showcase is done. They had brown bags where three consecutive weeks, every Wednesday there'll be an hour and a half block where the team, business owners, tech team worked on it. They come and they demonstrate what they did, how they did. They showed new ways of doing things. And it started with very thin attendance. But over a period of time, more and more people started attending. And to add to it, like many times, some of the senior leaders will come in and they say how it helps them. It started creating this momentum and once it picks pace, the snowball effect kicks in, more and more people start kicking in. So that said, this is not a day's job, a week's job, month's job, it can take sometimes over a year, couple of years. There's another challenge which we also need to be aware of is by the time sizable organization goes through an adoption process, there's still another change already started. So the first change is hard, but I think subsequent changes can become faster and faster. If you put it as a part of the formal change management process.
That's wonderful. And I couldn't agree more on the importance of building an ambassador community for your data literacy program, as you mentioned here, as a means to accelerate the word of mouth and the excitement. One thing that I've always been curious about is the role of the data governance lead in driving the data literacy agenda. Because there's probably out of the top five profiles within the organization that have a vested interest in increasing the data literacy of their organization. The data governance lead probably has to be in those top five profiles, but they're not formally linked either to the formation or the carrying out of the program. Usually that's done by the learning team. The CDO usually is the executive sponsor of the data literacy program. So maybe walk me through the role of the data governance lead in building an organization's data literacy.
I would say there are a couple of areas where the data governance role becomes very, very pivotal in terms of the data literacy program. So one is, I think having a standard around this training. This adoption is also key and nothing like a data governance person being a part of this whole discussion. That said, I think as a part of data literacy, what policies are, what standards are, are very important and that part of communication should be led by a data governance person. The importance of it, why it is needed. So take for example, in a banking or a financial industry where regulatory compliance is pretty high, the standards which are put in place by the data governance site has to be communicated to a lot of stakeholders. They're not just the end users, but also teams which are managing processes, teams which are managing consumers. Right. In those organizations, literacy is at multiple levels. It's executive level, it's at teams which are managing, processing, maintaining data. And the last level is people who are consuming data. So any sort of communication, training, chain management to be planned should be done in close partnership with the data governance and they will bring in aspects which are really, really specifically important for people at different levels in the organization.
Okay, that's really great, Saurabh. I couldn't agree more as well. And maybe to connect back to one thing that we discussed earlier in our conversation was how a big aspect of succeeding in a data governance program is ensuring that we're starting small and that we're not taking a moving train off of its track. Right? So maybe walk us through quick wins organizations can have on the data governance side and especially how it connects maybe to quick wins on the shifting left Agenda as well as we discussed.
So to start, I think you need a very, very strong partner in the business community. Once I have identified, what I'd like to do is identify a use case where that particular group of business users are not only having the most challenges, but also it impacts their day to day working. So take for example if I have a report which needs to be sent to the executive leadership team every day and I don't trust the number and my team spends an hour every day to check that data before they can send it to the executive leadership team and say let's just for numbers sake, I have eight people in the team, they are spending one hour each, I'm spending one day a week just doing that. It's a painful process, it lacks trust. But I would love to partner with this particular group and say help me extract what you check, how you check and let me turn it into something automatic. You don't need to use it, but let's try it. We extract that knowledge, turn it into standards, implement it in a way that's automatically kicks in and walk with a user team or this team the whole journey of saying okay, now you check, they check, these are the issues and you bring out an automated reporting. See, you're seeing go through this process and show them how this makes their life easy. Then what happens? It suddenly turns into this group of business users start championing your cause of data governance, then you pushing it everyone else again. I think starting small is critical because data quality, since we are talking about quality, can be like a rabbit hole in itself. There could be exceptions, there could be very, very specific things. So in place of that I think start with something which is very simple. Maybe 15% of the checks, 20% of the checks, what you need, establish credibility and over a period of time as things are needed, add more. One of the challenges like any other product development is 80% of the product development can be done in 20% of the time. But the rest 20 will take a lot more. And I follow the same rules with data, whether it's data quality, whether it is reporting. Start something which can be immediately used, make a credible example and then keep adding as more requirements, basically iterative development as you in data space.
Okay, that is awesome, Sourav. So Saurabh, maybe as we wrap up our conversation, maybe what are the key trends that you see in the data quality and data governance space this is this year, how do you see the shifting left conversation evolving this year?
I think there's a lot of awareness that has built, got developed over last couple of years data owners, data stewards have started sort of understanding, agreeing to this. They have started talking about data quality as an important piece of the whole data life cycle. And to add to it I think gen AI has done is the next level altogether for gen AI to work better to deliver you better results, you need better data foundation and I think that is adding to the importance of how data should be managed, how data should be governed, what are the ethics around it, how data quality should be seen more and more. I would say this is just starting and lot of tools have also started coming in. But I think more than the tools, the process part, the people part, the acceptance and understanding of the importance is the key which is happening.
Yeah and we definitely need to bring you back on Data Frame Sirab to discuss the data quality and data governance angle of generative AI. But as we wrap up srab, do you have any maybe final call to action or closing notes to share share with the audience?
I have just one message for the data governance data strategy community here is don't try to do big bank change, take it small adoption is a key. Having a right partner is the most important thing and once you establish a credible success I think the snowball will become bigger and bigger very fast. The key is collaboration and small start small.
Yeah, I couldn't agree more. Thank you so much Saurabh for coming on Dataframe.
Thank you Adel for having me. This is great.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra