Why language models hallucinate

OpenAI says language-model hallucinations persist partly because standard training and evaluation reward guessing instead of abstaining when uncertain.

GPT-5 hallucinates less than earlier models, but the issue remains, especially on difficult or ambiguous questions.

The company argues that benchmarks focused only on accuracy can reinforce confidently wrong answers, so incentives and evaluation rules should change.