Earlier AI models hallucinated constantly. Now improving them requires specialized expertise: building expert websites or explaining medical nuances takes hours and PhD-level knowledge. Lenny Rachitsky notes his expert network includes many degree-holders paid specifically for labeling and expertise.
Questions this video answers
80%
Chapters
When the models came out two or three years ago, they would hallucinate all the time. They would get basic answers wrong. As models get better, they need different types of data. And now you're at a point where one task is building an entire website by one of the world's best web developers, or it is explaining some very nuanced topic on cancer to a model. And these tasks now take hours of time, and they require PhDs and professionals. In some ways, we drove this. We would go to the model builders and say, we noticed that this is a problem. If you would like to fix it, this cadre of experts can do that for you. 80% of the people that we have in our expert network have a bachelor's degree are Greater. We have PhDs on the network earning, like, significant amounts of money doing labeling, contributing their expertise to these models.