CLAIM-2026-10-15-07

The best model solves only 12.0% of the 150 vulnerability scenarios at all three granularities (function, file, repository) with code that is both functional and secure; the project leaderboard defines this column as the share of the 150 scenarios solved at all three granularities, which resolves the scope of the abstract's '12%' figure.

Why it matters

Resolves the scope of the abstract 12% figure against the project leaderboard own column definition, so it is not quoted loosely later.

Sources

• arxiv2026last
• lastsecurec2026last