Most AI ROI metrics like token usage or time saved don't work at big companies. A dozen senior leaders couldn't agree on how to measure it. One company saw revenue per employee jump from $600,000 to $1.2 million, suggesting that metric actually captures what AI does.
Chapters
What's the ROI of AI and how are people managing it? These are people that operate at, we're talking about 9-figure, 10-figure companies, and some of these people are like the AI transformation people, for example. Nobody really had good answers is what I'll say. Measuring people on token usage is stupid, which I do agree, like primarily on token usage is stupid. Nobody has a clear model right now. Measuring on time, estimated time saved is also not a smart thing because it's estimated time saved. How do you measure it ultimately at the end of the day? I think it's still a conversation that we're having, but again, on a call with like 10, 12 people that think about this stuff all day, Nobody had a good answer. Isn't that interesting? One of the people on the call, their revenue per employee last year was $600,000. Today it's $1.2 million. And so I'm like, okay, there's some efficiencies there, right? What I would say is this, I find that measuring revenue per employee is a healthy way to look at it as of today.