Format Online paper / PDF
Location PART 3 - THE THIRD AXIS CHAPTER 12: DARK INFORMATION Cumulatively Amputated

"Relative probabilities assigned to incorrect classes can reveal how a trained model generalizes beyond the correct label."

The distillation paper explains that probabilities assigned to wrong answers contain useful information about how a model generalizes.

View Source
Source title Distilling the Knowledge in a Neural Network
Source authors Geoffrey Hinton, Oriol Vinyals, Jeff Dean
Source year 2015
Confidence high
Importance high
Back to evidence PREVIOUSNEXT