cd /news/ai-agents/ai-coding-agents-ace-isolated-tests-… · home › topics › ai-agents › article
[ARTICLE · art-174247] src=the-decoder.com ↗ pub= topic=ai-agents verified=true sentiment=↓ negative

AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

A new simulated-workplace benchmark found that AI coding agents, including Opus 5.5 and Astra, completed fewer than one in ten tasks end-to-end when required to work autonomously through messy daily workflows with colleagues, project boards and incomplete handoffs, according to The Decoder. The models finished clear, standalone assignments quickly but lost track when acting as autonomous developers.

recommendation

Test coding agents on end-to-end ticket closure with incomplete handoffs and project-board context, not isolated tasks; the simulated workplace showed fewer than one in ten tasks completed.

more in playbook: Evals and testing for LLM apps
by read1 min views1 publishedNov 22, 2026

A new real-world test puts AI coding agents in a simulated developer job with colleagues, project boards, and incomplete handoffs, where they have to keep developing software on their own and reliably close open tickets in a messy daily workflow. Even Opus 5.5 and Astra fall far short, solving fewer than one in ten tasks completely. The models finish clear, standalone assignments quickly, but they lose track as autonomous developers.

The article AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace appeared first on The Decoder.

── more in #ai-agents 4 stories · sorted by recency
── more on @the decoder 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/ai-coding-agents-ace…] indexed:0 read:1min 2026-11-22 · —