A user's AI agent suggested an expensive upgrade during a task, wasting credits and effort. The Clay team hadn't updated the agent's pricing documentation after a rate change, leaving it giving wrong advice. Jason M. Lemkin warns that agents need current training and docs or they'll mislead customers and cause churn.
Chapters
it said, okay, you're not gonna have enough credits to finish, so you're gonna have to upgrade. 'Cause this was to, again, this was around the time they announced the price increase. So at that point I was like, you've gotta be kidding me. So I just hit the upgrade button again. I'm tired. It shouldn't be on the customer to figure out, tired or not, it shouldn't be on me to figure out that the new plan was gonna be worse for this outcome and I should've just stayed on my legacy plan at the time and just bought more credits, which in hindsight, yes, of course I would've done. But again, when the agent was suggesting to me, hey, if you just upgrade your plan, you'll have enough credits, I'm just going to click that button. I literally— that's what I did. I clicked the button from the agent. I clicked one of the new plans or whatever, and then I finished the enrichment and I went about my day and I loaded up with my AISDR. So it was a, it was a double-handed—
I get that. But just then we can move on to the next topic. But I thought the second issue when you reached out to the Clay team was that, and I think this is something we all need to learn about agents, was they had actually not properly trained their beta agent on how their new pricing worked. Like they have not uploaded the documentation, the pricing, and we've seen this ourselves. If you don't keep, you know, Digital Jason, the digital version of me, it broke for 4 months. The old version, it didn't upload anything for 4 months. I didn't know it silently failed. So if you don't upload, if you don't constantly train your agents, they will give your customers wrong answers. So I think the second part was Clay changed their pricing. They didn't train their agent with the new pricing. So, so that's one of the reasons they gave you bad answers, right?
Yeah, because when I, when I flagged this to the Clay team, I was like, hey, just so you know, like, obviously we use a lot of agents, obviously for families a lot. Varun was in London, like, we're fans, but here's why I almost rage quit, right?
