Robyn AndersonCEO, Jam Ai · AI Implementation & Business Development Leader

chatgpt bias is a real thing

6 Apr 2026 · 1 min

Watch on YouTube

0:33

Algorithmic hiring tools learn from biased historical data and reproduce racist and sexist patterns, even when developers try to remove protected attributes like race or gender. The systems find indirect ways to reintroduce discrimination that vendors claim they prevent.

Chapters

Biased inputs leading to biased outputs is a big issue across the board here. The companies that make these programs will tell you that that is actually a good thing because it reduces human bias. But in practice, one report concluded that most hiring algorithms will drift towards bias by default because, for instance, they might learn what a good hire is from past racist and sexist hiring decisions. And again, it can be tricky to untrain that. Even when programs are specifically told to ignore race or gender, they will find workarounds to arrive at the same result.