This Support Bot Recommended A Competitor In The Exec Demo

21 Oct 2026 · 1 min
0:52

In this short narrative, the speaker describes how an AI builder quickly assembled a sales and customer‑support chatbot for an e‑commerce site using a simple markdown‑based system prompt. The prototype was built in about an hour and impressed the team, but it was initially naïve because few people understood how such agents functioned. Over time the project was expanded with proper artifacts, management processes, evaluation pipelines, and curated datasets, moving toward a more rigorous engineering approach. When the team later presented the bot to executives, the demo went awry: the executive asked the bot about competing products, and the bot began recommending those competitors. The story highlights the risks of deploying AI agents without sufficient guardrails, prompt controls, and bias mitigation, especially in high‑stakes sales contexts.

Chapters

More from Hamel

0:53
youtube.com

Why You Shouldn't Write 500 Evals First

17h ago
0:46
youtube.com

How Should AI Evals Be Used In Performance Reviews?

18h ago
0:29
youtube.com

Overnight Agent Demos Are Vanity Metrics

1d ago
0:53
youtube.com

A 100% Eval Pass Rate Is A Bad Sign

2d ago
0:39
youtube.com

Your Golden Dataset Isn't Golden

2d ago
0:37
youtube.com

Why You Shouldn't Simulate Your Users

3d ago
24:25
youtube.com

How to Evaluate Coding Agents

3d ago
4:19
youtube.com

How To Get Your Team To Invest In Evals

5d ago
0:47
youtube.com

Stop Splitting One Task Across Multiple Agents

6d ago
3:23
youtube.com

How To Decide Who Owns AI Evals

6d ago
0:41
youtube.com

The Two Biggest Mistakes Teams Make With Evals

1w ago
See all content