CLAIM-2026-09-19-07
Model-versus-human exact agreement on the automation ratings was 59%; human-versus-human exact agreement was 35%; model and human ratings were within one level of each other 97% of the time.
Why it matters
The measurement-quality number every summary reported without its comparator.
Sources
- anthropic2026measureme