"Penalising confident errors more heavily than appropriate uncertainty can encourage language models to abstain instead of guessing."
OpenAI proposes changing evaluation incentives so that unjustified confident mistakes are penalised more than appropriate expressions of uncertainty. The proposal makes abstention a useful system behaviour rather than merely a failed attempt to answer.
View Source