CLAIM-2026-10-01-04

The AutomationBench paper states that even the best frontier models currently score below 10%, reporting Opus 4.7 at 9.9%, Gemini 3.1 Pro at 9.6% and GPT 5.4 at 7.6%.

Why it matters

The April baseline is the comparator that makes the new figure legible. Without it, 51.3% is a number with nothing to measure it against.

Sources

• arxiv2026automatio