"DeepMind documented approximately 60 examples of specification gaming in which agents satisfied an objective’s literal requirements without producing the intended outcome."
DeepMind's collection illustrates the difference between satisfying a measurable proxy and achieving the designer's actual intention. It provides the conceptual foundation for interpreting reward-hacking behavior in coding benchmarks.
View Source