{"slug": "agent-waste-index-what-341054-public-coding-agent-runs-wasted", "title": "Agent Waste Index – what 341,054 public coding-agent runs wasted", "summary": "Metermaid AI scored 341,054 public coding-agent trajectories from 11 public datasets, including SWE-smith, SWE-rebench, Open-SWE-Traces, mini-coder-trajs and agentic-coding-trajectories, for loops, blind retries, oversized tool output, abandoned runs and cost by run length, capping each dataset/config/split at the first 20,000 rows. The company published the results as the Agent Waste Index edition 1.1, with the pipeline, detectors and a `sweep` command that rebuilds the Index from the hub available in its GitHub audit repository. Metermaid AI said dataset publishers who find a number wrong for their data should open an issue, and that the method notes carry a corrections list.", "body_md": "We scored 341,054 agent trajectories from 11 public datasets on this hub (SWE-smith, SWE-rebench, Open-SWE-Traces, mini-coder-trajs, agentic-coding-trajectories and others; full list in the repo) for loops, blind retries, oversized tool output, abandoned runs and cost by run length. Every run is scored by the same detectors on the same estimated cost basis, capped at the first 20,000 rows per dataset/config/split.\n\nPipeline, detectors and a `sweep` command that rebuilds the whole Index from the hub are at [GitHub - metermaidai/audit · GitHub](https://github.com/metermaidai/audit) ; tables at [The Agent Waste Index — edition 1.1 — 341,054 agent runs](https://metermaid.ai/agent-waste-index.html) . If you published one of these datasets and a number looks wrong for your data, open an issue; the method notes carry a corrections list and we would rather add to it than be wrong.", "url": "https://wpnews.pro/news/agent-waste-index-what-341054-public-coding-agent-runs-wasted", "canonical_source": "https://discuss.huggingface.co/t/agent-waste-index-what-341-054-public-coding-agent-runs-wasted/180539#post_1", "published_at": "2026-09-17 03:27:21+00:00", "updated_at": "2026-09-17 03:53:14.921172+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "developer-tools", "ai-research"], "entities": ["Metermaid AI", "Agent Waste Index", "SWE-smith", "SWE-rebench", "Open-SWE-Traces", "mini-coder-trajs", "agentic-coding-trajectories", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/agent-waste-index-what-341054-public-coding-agent-runs-wasted", "markdown": "https://wpnews.pro/news/agent-waste-index-what-341054-public-coding-agent-runs-wasted.md", "text": "https://wpnews.pro/news/agent-waste-index-what-341054-public-coding-agent-runs-wasted.txt", "jsonld": "https://wpnews.pro/news/agent-waste-index-what-341054-public-coding-agent-runs-wasted.jsonld"}}