"Smaller models can sometimes find it easier to recognise information gaps and admit uncertainty than models with partial knowledge."
OpenAI illustrates this with a Māori-language example in which a small model that knows none of the language can more readily acknowledge its limits. A model possessing partial knowledge must make a more complicated confidence judgment, demonstrating that calibration and raw knowledge are different capabilities.
View Source