CLAIM-2026-10-15-02
Every task specification in the benchmark asks only for functionality and never mentions security; hidden functional and security test suites grade the result, and a task counts only if both pass.
Why it matters
The grading rule is the whole story: an acceptance suite that never names security cannot reward it.
Sources
- arxiv2026last
- lastsecurec2026last