How Should AI Evals Be Used In Performance Reviews?

22 Oct 2026 · 1 min
0:46

In this excerpt, Hamel Husain argues that AI evaluation metrics are unsuitable for inclusion in employee performance reviews because they are unstable and tend to be goal‑seeking—shifting as objectives evolve. He recommends that performance assessments for roles such as customer support agents be anchored to concrete product or business metrics (e.g., resolution rate, average handle time) that demonstrably improve over time. Husain warns that if all eval metrics consistently pass, they lose discriminative power and become effectively useless.

Chapters

More from Hamel

0:53
youtube.com

Why You Shouldn't Write 500 Evals First

16h ago
0:52
youtube.com

This Support Bot Recommended A Competitor In The Exec Demo

1d ago
0:29
youtube.com

Overnight Agent Demos Are Vanity Metrics

1d ago
0:53
youtube.com

A 100% Eval Pass Rate Is A Bad Sign

2d ago
0:39
youtube.com

Your Golden Dataset Isn't Golden

2d ago
0:37
youtube.com

Why You Shouldn't Simulate Your Users

3d ago
24:25
youtube.com

How to Evaluate Coding Agents

3d ago
4:19
youtube.com

How To Get Your Team To Invest In Evals

5d ago
0:47
youtube.com

Stop Splitting One Task Across Multiple Agents

6d ago
3:23
youtube.com

How To Decide Who Owns AI Evals

6d ago
0:41
youtube.com

The Two Biggest Mistakes Teams Make With Evals

1w ago
See all content