"OOD detection in LLMs can be useful as a local engineering heuristic."
Liu and colleagues systematically evaluated OOD detection on LLaMA models ranging from 7B to 65B parameters. Their results demonstrate that practical detection techniques can distinguish unfamiliar from familiar inputs under evaluated conditions, supporting the manuscript's recognition of OOD detection as a useful engineering tool.
View Source