"METR developers expected AI to reduce task-completion time by 24%, believed afterward that it had reduced time by 20%, but actually took 19% longer."
METR's experiment documents a striking mismatch between perceived and measured productivity among experienced developers using early-2025 tools. The findings demonstrate why subjective impressions of AI-assisted speed are insufficient evidence of actual time savings.
View Source