CLAIM-2026-10-15-06

The benchmark's security suite replays the original proof-of-concept attack against the running program in a separate container after the agent stops, with no partial credit and no judge model.

Why it matters

A replayed proof-of-concept against a running program is a stronger signal than a static-analysis finding, and worth copying into a team fixture.

Sources

  • github2026alibabala
  • lastsecurec2026last