CLAIM-2026-10-10-04

The method generates per-trial tests targeting requirements the patch might violate, keeps only tests the ground-truth patch passes, and emits replayable evidence per confirmed failure.

Why it matters

The ground-truth filter is why the figure is a floor: every counted failure is a requirement the reference patch satisfies and the agent's does not.

Sources

  • arxiv2026testjack