CLAIM-2026-10-03-07
Across eight models with five reasoning settings, pass@1 gains 4.6 points from the lowest setting to the highest, with negligible differential gains on complex versus simple tasks.
Why it matters
The dial most teams reach for first buys four and a half points. The gate costs nothing and catches 782 failures.
Sources
- arxiv2026full