"An AI system can successfully optimize a measurable target while failing to achieve what humans actually care about."
Google DeepMind describes specification gaming, in which an AI system satisfies the literal requirements of an objective while missing the intended outcome. Its examples demonstrate why selecting and formalizing the target is a central engineering challenge rather than a problem solved by optimization alone.
View Source