"SpecBench measures the gap between coding agents’ performance on visible feature-level validation tests and held-out tests of interacting system features."
SpecBench introduces 30 systems-level implementation tasks with separate visible and hidden evaluation suites. Its design measures whether apparently successful individual features continue working when combined into larger systems.
View Source