Hamel Husain&#x27;s videos and podcasts

Misc Utilities

1d ago

Cookbook

1d ago

Evals: What to test

1d ago

Cheatsheet

1d ago

OSX Shell Tips

1d ago

Processes, Permissions and Moving Data

1d ago

0:31

Not Every Bug Needs an Eval

2d ago

47:59

Can Claude Build Your Evals?

2d ago

0:46

How to Get Your Team to Care About Evals

3d ago

12:47

7 Most Common AI Eval Mistakes (From Teaching 5K+ Engineers & PMs)

3d ago

Earlier this month

40:01

How To Test AI Agents With Simulations

5d ago

Scaling

5d ago

Security

5d ago

0:43

Why Your LLM Judge Should Say Pass or Fail, Not 1 to 5

6d ago

Q: What should I do when I can’t get my LLM judge to agree with human reviewers? A: Debug disagreem...

6d ago

One of the best parts of teaching is seeing things click for our students, especially on problems th...

6d ago

0:39

Don't Just Slap a Chatbot on Your Product

1w ago

19:56

Is Opus 5.5 Better At Writing?

1w ago

Q: How do we evaluate a model's ability to express uncertainty or "know what it doesn't know"? A: C...

1w ago

https://hamel.dev/robots.txt

1w ago

1:22

How to Do Error Analysis When You Can't Look at the Data

1w ago

13:24

I Ranked Every AI Eval Concept From Worst to Best

1w ago

Our AI Evals course is the #1 best-selling AI course of all time on Maven (and has been for a while)...

1w ago

Q: Can I use the same model for both the main task and evaluation? A: Usually, yes. Test whether th...

1w ago

0:38

Why We Tell People to Read 100 Traces

1w ago

Q: How do I know if I can trust my automated eval? A: Test it against human labels to measure align...

1w ago

1:07

Your AI Tests Are Supposed to Go Stale

1w ago

42:40

How to Evaluate OCR for AI Agents

1w ago