PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER BenchMaxxing

"DeepMind documented approximately 60 examples of specification gaming in which agents satisfied an objective’s literal requirements without producing the intended outcome."

DeepMind's collection illustrates the difference between satisfying a measurable proxy and achieving the designer's actual intention. It provides the conceptual foundation for interpreting reward-hacking behavior in coding benchmarks.

View Source