"Testing whether coding agents can keep changing a codebase without breaking existing behavior offers a useful measure of their long-term engineering ability."
Dex Horthy's July 2026 discussion, indexed by his organization HumanLayer, argues for evaluation based on incrementally revealed requirements and continued correctness. The approach connects the manuscript's external-judge argument to the practical problem of maintaining AI-generated software as specifications change.
View Source