CLAIM-2026-10-03-01

Incident-Arena, arXiv:2610.00648v1, submitted 30 September 2026, is a human-built benchmark of 20 carefully selected tasks grounded in real-world deployed open source software; each task deploys a production application to an ephemeral Kubernetes cluster, injects parameterizable faults and applies a sustained load profile.

Why it matters

It is a benchmark about running systems rather than repositories, which is the first time the thing being measured resembles what an on-call engineer actually does.

Sources

• arxiv2026incidenta