Why You Shouldn't Simulate Your Users

19 Oct 2026 · 1 min
0:37

In this segment of his talk, Hamel Husain urges product builders to rely on real user interaction data rather than attempting to simulate human users or long‑running agent conversations. He argues that faithfully simulating a human essentially requires building an AGI‑level system, which diverts valuable engineering effort away from the core product. Unless a team’s business is explicitly a simulation platform, the time spent on such high‑fidelity user emulation is wasted. Husain’s practical advice is to gather actual user traces—by recruiting friends, colleagues, or any willing participants—to inform product development.

Chapters

More from Hamel

24:25
youtube.com

How to Evaluate Coding Agents

20h ago
4:19
youtube.com

How To Get Your Team To Invest In Evals

2d ago
0:47
youtube.com

Stop Splitting One Task Across Multiple Agents

3d ago
3:23
youtube.com

How To Decide Who Owns AI Evals

3d ago
0:41
youtube.com

The Two Biggest Mistakes Teams Make With Evals

4d ago
3:16
youtube.com

Can One Model Run Your App And Evals?

4d ago
0:44
youtube.com

Why Generic Eval Metrics Waste Your Time

5d ago
21:18
youtube.com

How to Ace AI Eval Interview Questions (for Engineers & PMs)

5d ago
0:31
youtube.com

Not Every Bug Needs an Eval

6d ago
47:59
youtube.com

Can Claude Build Your Evals?

6d ago
0:46
youtube.com

How to Get Your Team to Care About Evals

1w ago
See all content