CLAIM-2026-10-01-05

Zapier's public AutomationBench leaderboard over the 600-task public split, using a strict pass rate scored 1.0 only if every assertion passes, is topped by Claude Opus 4.8 at 30.33%, followed by GPT-5.6 Sol at 29.17%, GPT-5.6 Terra and Claude Fable 5 at 25.83%, Claude Sonnet 5 at 24.00%, GLM 5.2 at 20.33% and Gemini 3.5 Flash at 14.83%. Gemini 4 Argon does not appear on it.

Why it matters

The best independently listed score on the strict metric is 30.33%. Any planning assumption built on a vendor's 51.3% is 21 points ahead of what a third party has published.

Sources

• github2026zapieraut