"In the original SlopCodeBench evaluation of fifteen coding agents across thirty-six problems and 196 checkpoints, no evaluated agent fully solved any problem end to end."
The 2026 study reports that its strongest evaluated agent passed 14.8 percent of checkpoints and that none completed an entire problem. These results document the difficulty of retaining correctness while extending an evolving software artifact across multiple stages.
View Source