Reinforcement Learning in LLMs - Hallucination

A model is trained with data, or even by another AI, and everything it learns, it memorizes and repeats without difficulty. It doesn't understand the content, it just estimates the best response based on patterns it has observed. But if it runs out of answers, rather than admitting it doesn't know, it prefers to make up one that sounds right, but is in fact pure hallucination.