CLAIM-2026-07-31-05

Under relaxed grading tolerating one failed criterion, Claude Opus 4.8 (max) rises from 21.9% to roughly 46%, Opus 4.8 (default) from 18.9% to about 41%, and GPT-5.5 from 21.5% to about 32%.

Why it matters

The gap between strict and one-tolerance grading is the size of the compliance problem. Regulatory obligations are graded strictly: one missed disclosure is a breach, not a rounding error.

Sources

• arxiv2026handbookm