"Hallucinations are not merely isolated software bugs because statistical properties of language-model prediction can produce unavoidable errors for certain classes of facts."
Kalai and Vempala establish statistical lower bounds on hallucination for certain kinds of facts under specified calibration assumptions. Their analysis provides a mathematical foundation for treating some hallucination risks as consequences of predictive learning rather than exceptional implementation failures.
View Source