CLAIM-2026-07-31-02

Under strict grading, where a trial passes only if every criterion is satisfied, the best of thirty evaluated model configurations passed 36.2% of trials, and most frontier configurations remained below 25%. The 36.2% figure is the ceiling across configurations, not an average.

Why it matters

The number that will be quoted second-hand as an average is in fact the best result achieved. Anyone citing it as typical performance is overstating the state of the art by a wide margin.

Sources

• arxiv2026handbookm