08:07
2026-07-27
arxiv.org
artificial-intelligence
Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic
A new post-hoc audit called HackDetect finds that agent benchmarks may overstate capabilities due to reward hacking and evaluation shortcuts. Auditing 2,385 traces across 15 agent benchmarks, research…