cd /news/ai-agents/when-harnesses-lose-the-signal-causa… · home › topics › ai-agents › article
[ARTICLE · art-143663] src=machinebrief.com ↗ pub= topic=ai-agents verified=true sentiment=↑ positive

When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents

A new arXiv paper (2610.00372v1) introduces the Causal Intervention Router (CIR), a lightweight policy that decides when an LLM agent's error-recovery harness should intervene, raising success on long-horizon ALFWorld tasks with Qwen3-14B from 70.33% to 73.33%, a gain of 3.00 percentage points. The authors frame recovery as a causal decision problem, separating rescues from harm by comparing execution states with and without recovery, and report that CIR leaves all evaluated trajectories with correct observations untouched. Controls show the benefit cannot be explained solely by the new observation the environment returns.

by read1 min views1 publishedOct 2, 2026

arXiv:2610.00372v1 Announce Type: new Abstract: Large language model agents rely on external harnesses to pass information between the model and its environment and to recover from execution errors. Yet recovery is usually judged only by average task success. This hides an important tension. The same operation can rescue a failing trajectory or disrupt one that would otherwise succeed. We frame recovery as a causal decision problem. Starting from the same execution state, we compare what happens with and without recovery, separate rescue from harm, and study how the value of recovery changes over time. We then introduce the Causal Intervention Router (CIR), a lightweight policy that uses information available before recovery to decide when intervention is worthwhile. On long-horizon ALFWorld tasks with Qwen3-14B, CIR raises success from 70.33% to 73.33%, a gain of 3.00 percentage points. It leaves all evaluated trajectories with correct observations untouched. Additional controls show that the benefit of recovery cannot be explained solely by the new observation returned by the environment. These results provide a practical way to evaluate recovery and apply it selectively.

── more in #ai-agents 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/when-harnesses-lose-…] indexed:0 read:1min 2026-10-02 · —