Why AI Companies Are Now Guaranteeing Results

14 Jun 2026 · 1 min

Watch on YouTube

0:57

In this commentary, the speaker highlights Cognition’s new AI productivity guarantee for its Devin product, which promises to fund a customer’s usage up to $10 million if the AI fails to deliver at least as much engineering value as the amount paid. The speaker frames this as part of a broader industry shift away from merely maximizing token consumption toward maximizing real productive output. Cognition has built a system that estimates an AI agent’s productivity by comparing its output to the time a human engineer would need to accomplish the same task, validated against real engineers’ time estimates on enterprise codebases. The speaker warns that open‑source models are rapidly improving, making such guarantees increasingly necessary for AI companies to stay competitive.

Chapters

There's a new AI productivity guarantee, and I think we're going to see a lot more of this. So I'm pulling this up right now. So Cognition says AI should earn its keep. Introducing the AI productivity guarantee. If Devin, which is their product, delivers less engineering value than you're paying for, Cognition will fund your usage until it does, up to $10 million. Okay, so that's a good guarantee, man. That's a good offer. So it's time the AI industry— for the AI industry to stop maximizing tokens and start maximizing productive output, which is what we've been saying for a while. Like, it's not just about token maxing, it's about output maxing, right? So we build a system to estimate whether an agent's output was actually productive, and if so, how long a human engineer would have taken to do the same work, validated on real engineers' time estimates working in enterprise code bases. So they do a blog post on this, but I think you gotta go in this direction if you want to stay alive, because these, these other open source models are catching up too quickly.