"Apple researchers led by Parshin Shojaee observed a complete accuracy collapse in tested reasoning models beyond certain puzzle-complexity thresholds."
Shojaee and colleagues evaluated frontier reasoning models using controllable puzzle environments with increasing compositional complexity. They reported performance collapse at sufficiently high complexity levels in their experimental settings, along with declining reasoning effort despite available token budgets. The study provides a complementary investigation of the limits of extended reasoning processes.
View Source