#169 Unlocking Efficiency Gains Through Process Mining with Wil van der Aalst and Cong Yu, Chief Scientist and VP Engineering at Celonis
28 Dec 2023 · 57 min
Wil van der Aalst and Cong Yu explain process mining, a technique that analyzes event data from enterprise systems to find efficiency gains worth millions. Companies like BMW and Lufthansa use it to optimize purchase-to-pay and order-to-cash processes, with results ranging from duplicate-invoice detection to reduced working capital.
Chapters
Hi, I'm Maggie, VP of Curriculum at datacamp and I know firsthand how overwhelming it can be to keep up with the rapid changes in data and AI. But staying ahead doesn't have to be hard. That's why our curriculum team has curated the best learning content to help you and your team stay ahead, covering everything from data and AI literacy for busy executives to cutting edge generative AI for developers, and everything in between. Whether you're upskilling yourself or your team, we make learning practical, engaging and flexible. It just works. Power your data and AI transformation journey on datacamp.com.
The most interesting thing to me is that process mining is really connected to the operations, the physical world of the company and there's a lot of process going on inside and outside the data system.
I started working on this in the late 90s as a research project and now it's a complete industry. So I think there are many developments that have happened that I find super exciting.
Foreign.
Welcome to Data Framed. This is Richie. Today we're going to be talking about the best kept secret in the world of data. It's a technique that could be used to save your company millions of dollars, but very few organizations seem to have adopted it yet. That technique is process mining and the idea is very simple. Every organization typically has lots of processes that have grown organically over time and and no one has ever gotten around to thinking about how they might be optimized. And they have more processes where the steps are written down but often they can't be followed and employees behavior doesn't reflect the official process. In both cases, by making use of data and process mining, you can make your workflows more efficient, saving you money and making your colleagues less frustrated. Today we have two guests from process mining company Celonis. Will van der Alst is their chief scientist and he's also a professor at RWTH Aachen University. In fact, Will's research into process mining and business process management has led him to be one of the most cited computer scientists in the world. Joining Will is Kong Yu Celonis, VP of Engineering for AI and Knowledge. Kong has been driving efforts to incorporate generative AI into the Celonis process mining platform. He was previously a research director at Google and an adjunct professor at New York University. In short, the two of them know a thing or two about process mining. Let's hear what they have to say. Will and Kong, thanks for joining me on the show today.
Thanks Richie.
It's great to be here. I think.
Just to begin with, let's talk about what exactly process mining is. So maybe will you can start. How do you think about it?
So process mining has been a technology that has been developed over the last, let's say, 25 years. So it starts from event data and the goal is to use this event data, which is available in any organization, to first show what is really happening. Often very surprising for people. So people often have an idea of what the processes are like, but then they see it based on the evidence. It's typically very different. And then you use, let's say, these process mining results to improve the process. So you can also identify where are bottlenecks that you did not expect or that you would like to remove or where are compliance problems. If you have enough data, you can even, let's say, predict that something bad is going to happen that kongs areas of expertise and in all cases you would like to take action to actually improve the process. So it's a very generic technology and it's pretty sure that in the future, let's say most organizations will use that for many of their processes.
I think a lot of people will understand the idea of data mining. So are process mining and data mining related to each other?
The difficulty is that people talk about AI, machine learning, data mining, and it's all very blurry. So I think the best way to explain it is that process mining is a unique technology. It is not the same as data mining. It is not the same as mainstream machine learning, for example, neural networks, the starting point for process mining, doing discovery and conformance checking is something very different. And it is different because it is this mix of both processes and data. Right. And that combination makes many of the algorithms unique. I understand it's very complicated, confusing for people. So you could say process mining is a kind of machine learning. And I would say yes, that is correct. But at the same time it's a very different technology than for example, deep learning on neural networks.
Okay, so it's really a specialized set of techniques in order to help you understand your processes and help you make changes to your processes.
Sure, sure, yeah.
Well, since you mentioned AI, perhaps Gong, can you tell us how AI fits into process mining?
Yeah, I think with the generative AI, I think there's a lot of potential and I think as Will already mentioned, there's a lot of the predictive process mining capabilities that we can build into and then also there are conversational interface that you can put over process mining technologies to have much better interaction between the process data and process insights. With human process mining as well mentioned it's like a somewhat complicated technology that's super important for the company. Therefore, having a convenient conversation interface is going to be very helpful for practitioners.
Okay, so it sounds like it's maybe early stages incorporating AI into process mining, but there's a lot of potential.
Very exciting. Yes.
All right.
I'd love to talk about that more later on, perhaps. But perhaps it's worth talking about how people actually make use of process mining. So maybe one of the most popular use cases of process mining at the moment.
I think many organizations start with standard financial processes. Any organization has something called purchase to pay, order to cash. The standard process is that an organization has to buy stuff and to sell stuff. Any organization of some size has that. And that is where most organizations start, for the simple reason that it is completely known what kind of data is available. It is pretty standard. So you can basically plug and play and immediately do process mining. And that's why many organizations start with that. We also have a lot of experience knowing in these types of processes what are typical problems. Because we are analyzing, let's say, the same process for thousands of organizations. And of course, you learn after a while, okay, these are the typical problems that you encounter within many companies. So that's the easy entry point. At the same time, I would argue that for a car manufacturer or for an airline or for a hospital, these processes are not the car processes. So for an airline, the car process is to move people from A to B. If you look at the car manufacturer, the car process is to build cars that are beautiful and are very reliable, et cetera. So what you see is that most organizations start with these standard, let's say, financial administrative processes, and after having positive experiences with that, they move more to the processes that are really unique and core to the organization itself. But of course, you should make more effort then, because then your process is probably unique.
That's interesting that you suggest starting with something that's standard, like the general administration financial stuff, and then moving on to something that's core to your business. You go for the easy stuff first and then move on to maybe the high value, but maybe a bit riskier stuff later on. Do you have any examples of companies that are heavily using process mining at the moment?
Yes, of course. There are many organizations already using process mining. I think many people do not realize that half of the Fortune 500 companies are already using process mining. What you also see is that, let's say the adoption in Europe is more advanced than the adoption in the US So what you see, it depends where the audience is. But in countries like the Netherlands and Germany, it is much more widely used. But if you think of, let's say, examples of companies, one could, for example, look at the car manufacturers and I think it's safe to say that most of the car manufacturers are already using process mining. So for example, if you look at the company like BMW that I know myself quite well, they are analyzing over 50 processes using process mining. And this ranges from, let's say, painting a car and these types of things to things related to, let's say servicing a car to the financial things that I was talking about earlier. So examples are omnipresent. It's also, if you look at, for example, medical companies are using it like a company like Uber is using it. The examples are everywhere. So perhaps Krong would like to add some examples.
Yeah, I think there's a number of companies, for example, HP and Dell working with us as well. And HP save a lot of money in terms of cash flow operations. And I think there's a, I think on our website we probably have a list of all the companies that we can highlight as well.
Okay, that's interesting. So it sounds like this is predominantly being used by perhaps larger organizations. So is there some sort of requirement to having like a large scale in order to be able to make use of process mining?
You're right. The threshold to get started with process mining is of course lower for larger organizations. So for example, we often use the 80, 20 rule that if you do process mining, you find out that 80% of the things that you're handling, you're handling them more or less correct. And 20%, there is a problem, right? There is a compliance problem, there is a performance problem or something like that. So if you are an organization and you only have 100 cases, that means that you find 20 cases where there is a problem. However, if you are a large company, like for example, Siemens, where you are having millions of transactions each year, and then let's say from a couple of million, 20%, you can see that the return on investment is much quicker. So what I expect to see is that it starts with the larger organizations. But of course our goal will be that process mining will become a kind of commodity that also, let's say smaller enterprises will use. But that's not the logical starting point. But we also have also many examples of, let's say, smaller organizations applying it. But you need to compute what is the return on investment of doing that. And for a larger organization that is much easier.
This is also where I Think the recent trend of large language model will probably help because process mining is a piece of enterprise software. As any enterprise software, there's learning curves and sometimes requires setup and all these kind of things. So in a lot of ways, large enterprises will have that capacity to do these kind of setup and, and onboarding. While for smaller ones, hopefully with generative AI and large language models, these conversational interface will make it much easier for people to get on board.
So you're sort of lowering the threshold in terms of how you get started with process mining.
Yeah.
Okay. I'd like to talk a little bit about maybe the more technical side of process mining. So can you give me an idea of what sort of techniques process mining encompasses?
So if you look at the different phases, if you would roughly look at what are the different steps that you apply when you do process mining, then the first step is extracting the data from your information systems. As if you're using Salesforce, Oracle, SAP or any of these enterprise software systems, they are loaded with event data. And the first step is always scoping what you're interested in, extracting it and making it ready to do process mining. So that's step one. Then step two is what we call process discovery. So based on the event data, you uncover what is really happening, so you create transparency. And as I mentioned earlier, this is often shockingly different than what people expect. And that in itself already has a value, right, because people become aware of many problems. I think in the back of the mind people had a notion that there was a problem, but it then becomes very visible and people will be eager to address it. That is step two. Step three is that you do conformance checking. And that basically means that you have an idea of what you want to happen and you look at what is really happening. And for the most important pain points, you start setting triggers. So if a supplier, for example, often changes the price, leading to all kinds of chaos in your organization, you can detect when that is often happening for a certain supplier. That's what we call conformance checking.
So this sounds like you might have two problems then. So either your process is stupid to begin with, or you have a sensible process, but people aren't actually complying with that process. Is that what I understand by conformance checking those two different cases when we.
Talk about processes, indeed there is the process what people expect to happen or what people want to happen. And there is reality. And conformance checking exactly tries to see where the biggest differences are. And there are many deviations that are pretty harmless, right? You don't have to worry about them. But there may also be, let's say, deviations that are causing incredible delays or are very risky from a compliance point of view. And if you have a lot of data then you can even go one step further and you can predict that there is going to be a problem. That is a use case that I think at this point in time is only interesting for companies that have relatively stable processes and are able to also precisely describe what they want to happen. In all cases, the final step is that you actually change the process because it's very important that you should not stop at diagnostics, detecting that there is a problem or predicting that there is a problem. It's very important to take the action. And that is the reason why many of our customers are earning a lot of money because they turn these insights into actions. And that is something that is crucial. So these are roughly the steps and I'm not sure whether Kong would like to add something to that.
I do want to say like the process are not necessarily stupid and most people design the process to certain desirabilities. And it's just reality is much more complicated. You may have an approval process in place, but suddenly a customer comes in over the July 4th weekend. Something has to be done, otherwise you're losing the customer, you override some of the stuff in order to make things happen. So in other words, people are trying to do the right thing. And the complicated reality is you have a lot more process going on and then things do deviate from the original design. The beauty of process mining is ability to capture these and really understand whether some of deviation may probably become part of the process. From now on, as you understand them, some of the deviations are not necessarily correctly done, therefore you need to fix them. So I think from that perspective it's actually very helpful. Even if you have very good process modeling capability, process mining is still going to be very useful as time goes on. And following that, I think after conformance checking we have this notion of so called process observability. Then some of the important thing is to basically put some of these things that you are very interested in looking at monitoring into the dashboarding and through our EMS system so people can observe them on a regular time frame. And then as will said, as you observe them, you design actions, you design certain things to improve your process and saving money and be more efficient as you run through the process.
Perhaps you can tell me a bit more about the predictions.
I don't know.
Maybe.
Kong, do you want to take this So I think like with the standard machine learning problem, usually the output you get from it is like, oh, I've made a prediction of something. Will, you mentioned that maybe sometimes you want to make predictions about processes, but in general what is the sort of output from a process mining analysis?
I can give some very concrete examples. Like we use the prediction capability pretty broadly and it's usually trying to predict something bad is going to happen, help you, alert you ahead of time so you can do something. Correspondingly, some of them are actually machine learning and supervised learning. Some of them are actually unsupervised learning. For example, we have this capability called a duplicate invoice checker. What it's trying to do is basically like looking through the invoices you're paying, understanding which two invoices are actually duplicates of each other. And if it's identical, it's very easy, but most of the time it's not identical. There's a different name, slight typo in the supplier name, and slight different amount, slight different date, all these kind of things. Right. So internally we have built a duplicate invalid checker using so called clustering and matching machine learning based matching functions in order to detect those duplicates. Now if you imagine it's a lot easier to prevent the duplicate was being paid instead of after you paying them and you have to chase the money back. So this is where the predictability comes in. You look at it and as the invoice coming through you basically predict, okay, this looks like a duplicate, therefore you want to put a block on it or you slow its payment and go ahead and examine them before you really pay them. And that's one example here. We don't really use so called supervised machine learning. It's more unsupervised matching functions and similarity function language model can already help a lot over there. But there are other more predictive cases. For example, you want to predict whether this invoice is going to be paid late and you're going to miss the deadline or your supplier is going to pay you late and you're going to, they're going to miss the deadline. So all these kind of things, these are basically more predictive. You have to look at the behavior of the past supplier and the behavior of such kind of invoices with the same amount, amount and then there you have more sophisticated supervised learning capability. But when we do supervised learning we always like, we don't mix the data from different clients. We basically protect the proprietaryness and the privacy of our clients, making sure no data leakage is happening. So we actually have to tailor the model to specifically to the client's information in order to build a model.
So it just seemed like even fairly simple but common tasks like checking whether this invoice is a duplicate or not. Once you're getting at scale you've got a chance for like really improving the efficiency of your financial set up and things like that.
Yeah, millions of dollars easily.
Yeah, that's a great benefit.
Saving millions of dollars.
Excellent. In terms of tooling, of course you're both strongly affiliated with Celanis, but can you maybe you talk about what the tools people use for process mining?
Yeah. So if you look at the market, it's very interesting that Gartner released the so called Magic Quadrant earlier this year identifying process mining as a separate category of tools. Right. And I've been working in the field for many years and I'm very happy that it is now recognized really as a separate, let's say category of tools. Like if you look at the market as a whole then like I think There are like 40 companies commercially offering process mining capabilities. There are let's say quite some companies offering this. However, if you look at like the market share, let's say SOL owners are by far the largest. Right. It depends a bit on how you count, but I think everybody agrees that more than half of the process mining customers are Solonus. I think it's also important to differentiate if you talk about process mining, there are let's say process mining tools that focus more on the specialist, the data scientist that is using it as a tool. And there are more, let's say what we call enterprise level process mining tools that are broader where the goal is also that many people in the organization are consuming the process mining results. Earlier when I was talking about conformance checking, I was basically talking about making the differences visible between what you want to happen and what really happens. And it is very important to make these things visible at a large scale. So we have several customers where thousands of users inside the organization are looking at these results and this is key because you can only, let's say change behavior and you can only change processes if people are aware of the problems. So I think there is a, to answer your question, there is many offerings but they are not necessarily comparable to each other.
So well, maybe take the enterprise and the sort of individual data scientist cases separately. But so I presume like your event data is Aglipa in a data warehouse or something like that. So is Solanas, is that going to hook up to like I'm trying to work out how it fits in with a broader software ecosystem. So does Solana hook up with your data warehouse? Is that what happens?
You can think of process mining as a layer on top of existing applications. So there is data in all the different source systems. So like an organization of some size has 200 different information systems, Salesforce, SAP, Oracle, et cetera, et cetera. And most of the process problems are not inside a single system. Most of the process problems are, let's say, at the boundaries of all of these different systems. So that's why for us, it is very important to extract these event data from these source systems and bring it into a shape that you can actually use it in a meaningful way. And this is often, let's say, the part where most of the effort goes into. After that, process mining does its job automatically. But bringing the data in the right shape is something that is very important. If you think of classical data warehousing systems, they typically mostly work with numbers, if I can explain it like that. So they are counting how many items did I sell in this month, et cetera, et cetera. If you look at event data, it is slightly different because these are also the steps in the production process. I don't know, the treatment of COVID patients, where we record what kind of medicine a patient gets every day, et cetera, et cetera, et cetera. And this is different data than data typically in the very idealized data warehousing environment.
I think earlier we talked about the difference between process mining and data mining. I think to me, when I joined the company a year ago, the most interesting thing to me is that process mining is really connected to the operations, the physical world of the company. And there's a lot of process going on inside and outside the data system. That's super interesting if you can. Actually, that's why I think we are at the first innings of process mining. Because once you start bringing both data setting inside the ERPN and data warehousing as well, data going on in the factory, fraud, all these sensor things, all these combined together, it's amazing how efficient you can make corporation and enterprises be. Right? So to me it's like fraud, creating the assembly line, this kind of thing.
Yeah, certainly improving efficiency is something that's top of mind for a lot of businesses right now. So it does seem very timely to be talking about this. So one last question on tooling before we move on. We talked about the sort of Syllanas and the enterprise use case for individual data scientists. I know we Have a lot of Python users, a lot of R users in the audience. So how might they get started going about process mining?
Yeah, I'm actually very new, so Will has a lot more knowledge about this and I think Python is certainly helpful and I think if you want to do machine learning on top of the process data and all the things Python within Solana so we offer a so called machine learning workbench as well to help people have Python scripts run. We also internally has this SQL like language called a process query language which provides a lot of capability and functionalities for you to interact with the process data in a much easier way comparable to SQL. And this is, I think, I don't know if we have a. We have a whole website section dedicated to edup, educate people about Pico, which can definitely be a good starting point to look into. I know in Europe Will has classes and teaching people about process mining as well as Pico languages.
So perhaps to add to that, if you look at the scientific world, let's say PROM is one of the, let's say standard tools that people use. It is also a tool with the ui. I would say it is not intended as industry sprang, but more as a playard for all kinds of algorithms, et cetera, et cetera. Of course, what we see in the last like five years is that many young people are using Python. We also developed something called PM4Py, that's a python library where you can apply the basic algorithms. It is also possible, let's say from Celonas to let's say call these types of routines basically like any Python library. However, I think it's very important to distinguish between let's say the enterprise situations and let's say the educational situation because they are very different. So if you are dealing with, I don't know, billions of events, let's say most of the open source stuff does not work anymore. And I think even if you look at well known cases like the, let's say purchase to pay in order to cash and all of these standard processes, I think people typically underestimate the complexity of the data models behind it. So this is not a simple flat file. You are dealing with suppliers, with customers, with orders, with items with invoices, et cetera, et cetera. So this is typically, let's say quite complicated. As such, there are these open source and Python alternatives to get in touch with the technology and really understand it. But if you go to the enterprise use case, you typically need to start using commercial software.
The message I'm getting is that it actually requires quite a lot of data engineering in order to get started with this. Because your data for any given process is going to live in several different places and you've got to find a way to bring it all together to start doing the analysis.
That's also why I indicated that many organizations start with the standard processes where we can really help people to get started super quickly because then we know what tables to look at, et cetera. Just imagine that if you are ordering something from Amazon or something like that and you have dragged and dropped some articles on your shopping list and you say, now I buy something, you should imagine the moment that you push the button, okay, now I pay that in the information system, many different tables are being updated just by this single action. Because the table with customer information is being updated. But you have an order, the order consists of multiple items, the items that you have ordered, some may be in stock, some may not be in stock, some are sold directly by Amazon, etc. Etc. So behind the scenes lots of things are happening. And for the known use, cases like this is pretty standard. But if you go to a new application domain, this is more involved.
Also, in a typical enterprise setup, there's usually multiple Personas. As Will was saying. Like with the commercial software, you can have the analysts and data scientists setting things up and then the business users can just interrogate the data in a much more intuitive and straightforward way. And for salons for example, we have this product called a business miner where you don't really need to be a data scientist and you just go in and it will highlight with a few, you answer a few questions and boom, you will get very easy to monitor kind of dashboard thing.
So perhaps for any organizations wanted to get started, you mentioned that like the financial cases are easy, I guess like all the data is going to be in Salesforce or some equivalent. So maybe it's just like one or two sources to deal with rather than the process being spread over lots of different cases. So who needs to be involved in adopting process mining? Like what are the kind of roles or teams that need to be involved in like your first process mining project. Kong, do you want to go first this time?
Sure, I can give it a try jumping here. And I think the first thing is you need to have a company executive leadership commitment to improving the process and looking for efficiency. And without that it's probably difficult. And then once you have the support of that and you need someone like data scientist or analyst with the technical mindset and willing to work with, for example, Synonymous and in order to start with some use cases and drive it through and then after the initial setup, I think you probably want to have stakeholder buy in from different lines of business. For example, we can monitor the AP process or conspirable process. And then whoever is the line of business owner, the CFO's financial directors needs to be like basically monitoring them and be bought into the whole thing. So Will, do you have anything to add?
So I think if you look at research, then what you see is that let's say the organizations that are most effective in applying process mining, they build this kind of center of excellence. So what you need is you need to have people that have the technical skills to work on the data pipeline, et cetera, et cetera. You also need to have people that have domain knowledge, et cetera, et cetera. So you typically it is best to have a center of expertise in a larger organization because that also helps you to scale. And so one of the things that I think is super important if you do process mining is you do not don't want to do process mining for a single department or a single process. That is the dumbest thing that you can do. And sometimes comparing to making the weather forecast. So if I want to invest in making a weather forecast, I'm not going to make the weather forecast for a single day in a single city. If I want to make weather forecast and it has to pay off, I need to do it for all the cities every day. And the same applies to process mining. So you need to have this center direct of expertise. They do not need to be huge, but they need to have the capabilities in such a way that you will not apply it in one process. You will apply it in 50 processes continuously every day. And I think this is very important. And then we get back to the Personas that Kong mentioned before. Suppose that you have, I don't know, a center of expertise of let's say five to 10 people. They can have an incredible impact on the whole organization because after they have done their work, there are thousands of people that may be consuming these process mining results every day. And sometimes even these improvements are done automatically without people really knowing that behind the scenes process mining is, let's say, removing certain inefficiencies that are known.
Another thing I think I forgot to mention is that because process mining software typically interact with the ERP system and and various things, it is also important to get buying from the CIOs and NLP department. And sometimes the center for excellence will was talking about is part of the IT department CIO and then things can become smooth. And if they are not, then we also do need to align with the IT department. Very much so as well.
Ah, that's interesting that this would live within an IT department maybe rather than under the Chief Data officer.
I think that depends on the Enterprise center for Excellence for some companies live under chief Data officer or even like directly under the CEO's purview. Some others are sitting under within CIO. I actually don't know the percentage. I will probably have a better idea.
Like also feel that organization has been relabeling things a lot in recent years. So I think it's very difficult to put a number in general. Process mining is of course on the interface of IT data and business. Right. And that makes it very difficult to pinpoint at one specific location. It's also why top level management support is super important to get this going.
And also I want to say like Will said, like you can start with one process, one department and the idea is like you try it out on a few small process or a few standard process and see the benefit of it, then you can grow. It's not like oh every time you commit you have to commit 550 process. I think you can always start small to see the benefit.
Yeah. So I was actually wanting to pick up on that point. So I can see how there's definitely a benefit to dealing with lots of processes at once because if you change one process and you optimize that then maybe it's going to just cause a bottleneck somewhere else. But how do you go about scaling then? Like have you got to go from one to 50 processes pretty quickly then? Or can you start with one and see how that works and gradually build it?
So I think it's very important to first understand the technology and for that you need it's best to start with a fairly straightforward process and then doing it. But at the same time I think it's very important to have the ambition level to grow that because the benefits come really with scale. The speed at which you would like to do that I think very much depends on the organization. Of course most organizations also first want to see evidence that really works before they, let's say, invest more money. I think that's also perfectly normal.
Yeah, I think Richie was asking about how do you go from one process to another. I think in the this is actually a very nice segue into object centric process mining Will and because I think before the introduction of object centric process mining it is indeed somewhat challenging going from one process to another because all the processes are independently processed. With object centric you don't deal with the process, you deal with business objects like an invoice. Invoice can go through many processes, order to cash, accounts payable, accounts receivable. And these object actually connects all these different processes together. Now with object centric process mining, you do a lot of object modeling upfront. Once you do that first one or two, then extending to the rest of the process is actually much easier compared to before. So I think Will has been talking about objects, entry, processing, mining for a long time as I'll let him elaborate on the benefit of that.
So to clarify it for the people that are listening, the traditional setting of process mining is that you focus on a particular process. So you now want to improve this process. And the process is typically defined by something that you're handling, which we call a case. So you can track one production order, you can track one shipment, you can track one COVID patient, whatever setting you have. So that's the classical setting. So all the events that you collect them, focusing on the single case notion that leads to the situation that if you're doing process mining in the classical sense, for example, like in the BMW setting where you have 50 processes, then you start extracting 50 times data from your source systems. And each time you extract it from the viewpoint of one particular process that you would like to improve and understand and see the problems there. If you do object centric process mining, you take a more holistic approach. You don't extract the data. Having in mind, now I want to analyze this particular process, I want to track this particular case, but you extract the data looking at basically all the events and all the objects that are in scope like we are now in this meeting. So there are four persons involved. We could think of many more objects involved in this. In the classical setting we would either follow the process of Kong, the process of Will, the process of Ricci, but now we look at all of this in a holistic way, capturing the events and the objects as they are really there. And after we have extracted the data, we start picking, okay, we would now like to analyze this process from this particular viewpoint. And this is a, let's say a super powerful mind shift that is now, let's say ongoing. I've been doing research in the area for a very long time and Celonis is the first, let's say commercial vendor, really embracing this type of notion of which I think will fundamentally change the way that we talk about processes and do process mining.
So this sounds like it's really going to help you understand the interactions between processes rather than just looking at individual processes.
So think of a customer that places an order which needs to be assembled to order. So the customer places an order and now things need to be assembled. And of the things that are being assembled, some of the things may be in stock, but other things are not in stock and then you need to procure them. So one problem in procurement can in the end influence, let's say, something at the other side of the organization. The same as that if you have procurement problems that may lead to higher shipment costs because you start shipping things in smaller batches, etc. Etc. So there are all of these interdependencies that you can only see if you have this more holistic view that I was just describing.
Okay. I'd like to talk a bit about the sort of rewards from doing process mining. So do you have any sense of like how you go about measuring the benefits from examining your processes and updating your processes?
So if you look at our website and you will see many examples, I'm always a bit hesitant in the sense that it's much better that our customers themselves say how much that they save. But we have many examples where customers are really saving millions of euros or dollars each year by simply applying process mining. And as I said, these large numbers also often come with a large scale. These are larger organizations. And if I mentioned before, if 20% of your cases have certain problems and you can remove them, that is incredibly powerful.
Yeah, I think there are always two kinds of savings that you can think of. The one kind is very quantifiable and meaning you know how much money you're saving. Like duplicate invoice detection. Right. So and for the duplicate invoice detected and you put a payment block or you get the money back. These values combined together is very clearly, you know, like how much return on investment you're already getting just by the in that. And there are also other improvements that are more like KPI level, not necessarily in dollar amount. For example, using process mining, you can improve your customer satisfaction. If you look at customer support flow, you may be able to improve your working capital, increase that by 20% or something like that. Right. These don't necessarily translate to the major bottom line savings directly, but in most of the enterprise there's a conversion rate where the CFOs and CEOs use. Okay, if I save 20%, like improve 20% on working capital and how much does that actually translate to my bottom line saving. And if I have like this customer Satisfaction improve by 10%, how much does that will translate to top line growth in the future? And we as will saying like we typically let the customer tell us and decide and instead of tooling our own home. And for the second kind, but for the first kind, we exactly how much money we are saving the customers.
So if I may add two things to that, because I think it's an important point. I think the first point is that the benefits are clearly quantifiable. At the same time, we enjoy working with organizations where people feel a responsibility that the processes are running correctly. So if you think about it's astonishing how many organizations are paying invoices twice. It's really astonishing. So if you are a customer and you go to a restaurant, you will never pay twice. And if somebody would say, yeah, you're paying twice, you would not ask what is the business case? No, you don't want to pay twice. If you go to the organizational setting, I think if you have your processes under control, you don't need to have a business case to avoid that you're paying things multiple times. I think it's very obvious. I can also mention one other example that everybody can imagine how it works, which shows a benefit which is the result of having better operations that immediately impacts also customers. So for example, Lufthansa is using process mining for their standard processes, but they also use it to, let's say, minimize delays. If you look at Frankfurt Airport, Munich Airport, like large hubs of Lulufthansa, their process mining is being used to analyze in real time what are the causes of delay. And then you would be astonished that the moment that the plane lands and takes off again, let's say approximately 80 unique events are being recorded. And you should think about things like fueling starts, fueling completed, baggage unloading started, baggage unloading completed, gate open, et cetera, et cetera. So you see all of these things and I find it fascinating because if you think about this in one hour, many things need to happen concurrently. And if one of these things fails, if the cleaning crew is not there, the whole flight gets delayed. And in the European flight, so it may be that the plane is making, let's say eight legs on one day. If in the morning you have a problem, you have a problem everywhere. And I think it's a nice example that you cannot immediately put into money, but where it is clear that because of process mining, you can really reduce the number of delays that planes have by really analyzing what the root causes are in real time. And I think it's a very nice example next to financial things where people, if they stand in an airport that they realize that processes need to work. You typically only realize that there is a process if it doesn't work that then you are aware of it. If it runs well, you're not.
Yeah, here's one concrete example where with Johnson we looked at their using process mining to look at all the delays and at the end of the project we actually realized 20% improvement in manufacturing lead time, 30% reduction in throughput time and 40% reduction in price changes. So these are very concrete cases that enterprise customer have been benefit from benefiting from process mining.
I mean those are both great examples. I think certainly a lot of people are going to be wishing that airlines did a bit more process mining to make sure their vacation flights are on time. And certainly that does seem like a really like a big enough improvement in the process, like saving enough money for Johnson. But that's a real competitive advantage there in terms of the timescales for a payoff. I know often when you have a new idea, management often are a bit antsy about making sure there's a quick payoff. What sort of a timescale are we looking at from adopting process mining to seeing those improvements?
That's it. So if you to get started with process mining, your first project typically will take a bit more time to get started, but after that to roll out to the next process are things that are going much faster. And so to roll out process mining you should think in terms of weeks to get it running. Then people need to get used to it. But basically the results are there immediately. We rarely encounter processes where everything is perfect. Right. If everything is perfect, you don't have to do process mining. So you typically start seeing improvements pretty quickly. But you need to realize that process mining is a continuous effort. You're saving time. So even if process mining is running year after year, you're saving let's say money year after year. Because if you would stop doing process mining, probably let's say the unhealthy habits in the process would slip back into it again, etc. Etc. So I think to say it's not like you now make one big saving, it's something that is continuous and the longer you use it, the more you save.
Yeah, we have clients working with us for five plus six plus years and I don't know what's the longest that we'll probably have some idea. But I think it's very common. The clients, once they get a taste of how process mining is helping them monitor the process and improve the efficiency of their operation and they really want to apply it to more and keep using it.
Okay, so maybe a few weeks to months to get started and then something you're going to work on over a period of several years. So it does seem like that the main point of this is just to keep improving processes over and over again. So how do you build up that feedback loop to make sure that processes do keep improving? Once you've like, you don't just do the analysis and then it goes nowhere.
So the two challenges, and we spoke about one challenge, I think a lot that is, let's say getting the data into shape to do process mining, assume that one has done that, then the other challenge, like the process mining technology does what it should do, right? It always works, it's a proven technology. But then of course the last part is how are you going to implement the changes? The moment that you see these inefficiencies, that's something that's very important. And there some of these improvements, they are basically manual. You see that there are lots of inefficiencies in a certain area. You give the feedback and people get all the work instructions and then hopefully it works by itself, but you continuously need to monitor it. So the feedback loop there is, let's say, I don't know, every week or every month, look at the actual data and if you see that people start again working in the old way, you need to correct that. With the more, let's say, mature customers that we have, this feedback loop is more or less automatic in the following sense, that for the known inefficiencies and the known problems that we frequently see, we set up workflows where from the process mining you're automatically triggering workflows, interacting with the source systems to automatically overcome these inefficiencies. That's why I said earlier you can think of process mining as a layer on top of existing systems. So for example, we have like a component in Celonis that's called Action Flows. It's a company that we bought. Integromat is now called make. And with these workflows we can interact with over 1,000 other information systems. So of these 1000 plus, SAP and Salesforce are for example, two examples of what we can interact with. And of course this is super powerful that the moment that you see certain known inefficiencies that you immediately respond in the SAR system To make sure that doesn't happen again. And then it becomes something automatic. Of course what you see is that if you think about process improvement, you always start with the low hanging fruit that is relatively easy. After you have that under control, you start looking at the more advanced things as similar. In the beginning, probably, let's say predictive analytics are not so important. If you have lots of inefficiencies and obvious problems, you should first address those. But as you get more mature, you also go to more advanced types of analytics.
And it seems like there's an aspect to change management here, especially when you've got lots of different teams working on a particular process. Do you have any advice for how you can handle the people side of things and managing across different teams and roles?
So here it is super important, as I think we have mentioned before, is that there is top level support for doing process mining, right? Because if you find problems, you need to be able to address them. And there may be all kinds of, let's say internal politics involved. So change management is super important. And also buy in from higher level management is also something important. On the other hand, the power of process mining is that it is not a PowerPoint. People, if they look at the PowerPoint, they can question it. If you look at process mining and you see a certain inefficiency or you see certain compliance problems, people cannot deny it. Because if you see, for example, that the check is often bypassed, you can simply click on that line and you can see exactly the cases that had this undesirable behavior, et cetera, et cetera. And I think in change management it is super important to be able to present results that are undeniable. If people could question the accuracy of the statements that one is making, nothing will change. But if you can always drill down and show, okay, this is not some PowerPoint diagnostics, you can really look at the cases that had this behavior and what they were costing. I think that really helps change management. But in the end it's important that people are willing to change in that setting.
I think in the longer timescale. We believe even it's happening now already in Europe. We believe process mining is becoming an indispensable tool, just like a quarterly business review and revenue prediction that you need to do periodically. And the COO and CFO and even CEOs will have to periodically look at those process mining observability results and understand how efficient the company's operations are and figure out ways to make them more efficient. And I think Celonis has been working with a lot of our European customers and and they're already getting there in the US it's just picking up.
All right, so before we wrap up, can you tell me what are you most excited about in the world of process mining at the moment?
I have a lot of things very excited about, otherwise I wouldn't be joining this company a year ago. But one of the things that I think is super interesting to me and internally we're just discussing with generative AI large language model, there's going to be a lot of transformation happening in the process of the companies, right? Think about all these AP clerks and encoding GL code in your invoices and all these are going to be disrupted by large language model and machine learning. And during this transformation process, it's very important for you to for enterprise to monitor how effective these transformations are. Are they actually improving the desired KPIs you care about? From that perspective, the process mining is your observability to and you keep monitoring your process. You understand through this AI transformation how efficient, how effective your process has become. And I think this is like there's no other tool better than none of the other tools you're thinking about. Like a data mining or BI is merely the process mining maturity in terms of observing your processes. So especially in this time, I think a lot of the CEOs are thinking about like how is AI going to impact my business and my operations and it's the right time to pick up process mining and really use that to monitor. And I think this is probably one of the most exciting things I'm thinking about. Of course there are others as well.
For me, the whole area of process mining is super excited. I started working on this in the late 90s as a research project and now it's a complete industry. So I think there are many developments that have happened that I find super exciting. But on the technical side, when I talked about, let's say, the two innovations that I find most exciting at this point in time, one was already mentioned that was object centric process mining. So that requires us to basically reinvent existing process mining techniques and bring them to another level. And that is something that is super exciting. And we are working on that both on the research side and on the company side. We are working on that with many people. All the people in the field see this as one of the breakthroughs, let's say, of the last 10 years. What is happening now? So that's super exciting. Another thing that I find super exciting is that I think many organizations are struggling with applying machine learning in a business setting. And I think process mining is the technology to help lower the threshold for organizations to start using machine learning in a meaningful way. I expect that many organizations will get disappointed that they have unrealistic ideas of everything that they can do. And I think process mining will prove to be something that is very down to earth that will help you to generate the machine learning problems where, let's say you get really reliable results. So I think these are, for me, the two things that I will be enjoying working on the next couple of years.
Excellent. It does really feel like process mining is just about ready to hit the mainstream and get much wider adoption. All right. Brilliant with that, I think. Thank you both for your time. It's been great having you both on the show.
Thanks, Richie. Enjoy the conversation very much.
Thanks, Richie. It was great.
It.
More from Richie
#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota
#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon
#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple
#355 AI's Impact on Databases with Shireesh Thota, CVP of Databases at Microsoft
#354 Beyond BI: Decision Intelligence with Graphs with Jamie Hutton, CTO at Quantexa
#352 AI Agents at Work: What Actually Breaks (and How to Fix It) with Danielle Crop, EVP Digital Strategy & Alliances at WNS
#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI
#350 How to Make Hard Choices in AI with Atay Kozlovski, Researcher at the University of Zurich
#349 From AI Governance to AI Enablement with Stijn Christiaens, CEO at Collibra