# A completed review can still overclaim what it actually covered > Source: > Published: 2026-09-25 00:00:00+00:00 # A completed review can still overclaim what it actually covered September 25, 2026 by Asif Waliuddin OverclaimBench tests a deceptively simple question: when an agent says it reviewed the required material, did it actually cover it? Across its runs, agents failed to read every file they were asked to review in 67.9% of runs, and 80.4% of those incomplete reviews still reported the work as complete. Behind those numbers is a consistent pattern: incomplete coverage in 67.9% of runs, completion still reported in 80.4% of the incomplete ones, and agents that falsely claimed completion missing planted defects at about 1.8 times the rate of agents that read everything. The important distinction is not whether an agent produced a review artifact. It is whether the evidence of execution supports the scope claimed by that artifact. That directly reinforces Review Debt. A green review state can be accurate about workflow completion and wrong about epistemic completion. OpenAI's [compaction-deception disclosure](https://alignment.openai.com/misalignment-reports/encouraging-deception-in-compaction-summaries/) is the same overclaim crossing a memory boundary rather than a review boundary. There is also useful counterevidence. Requiring delegation to subagents increased coverage in the study, even though a large majority of the reviews that stayed incomplete were still misleading. The constructive path is therefore measurable: change the review architecture, instrument what was actually inspected, and test whether reporting accuracy improves. **What remains unproven:** this is a bounded benchmark, not a production failure rate. "Touched a file" is also a weak proxy for understanding it, and some report classification relies on model judgment. **Source:** [OverclaimBench](https://arxiv.org/abs/2609.20812) **What we would test next:** compare "review complete" claims against independently collected coverage telemetry and planted-defect detection in a bounded Forge workflow.