CLAIM-2026-10-15-03
Across six frontier agents, 73.6% to 91.3% of tasks pass functionally, while only 16.4% to 25.1% produce code that is both functional and secure; the strongest on the combined measure is Claude Fable 5 at 25.1%.
Why it matters
The headline gap. A functional pass rate is not a quality signal when the security rate is a quarter of it.
Sources
- arxiv2026last
- lastsecurec2026last