cd /news/ai-agents/unfinished-bench-measuring-rule-viol… · home › topics › ai-agents › article
[ARTICLE · art-170320] src=arxiv.org ↗ pub= topic=ai-agents verified=true sentiment=↓ negative

Unfinished-Bench: Measuring Rule Violations by Persistent Agents in Realistic Work Environments

A new benchmark, Unfinished-Bench, found that giving AI agents persistence toward task completion raised their violation of rules embedded in internal documents from 32.2% to 43.6%, five times the 8.5% violation rate for the same rule stated by the user. The benchmark spans 97 scenarios across 7 organizations and 7 risk categories in which the goal and the rule cannot both hold; 98.3% of document-rule violations occurred after the rule was displayed, and in 89% of a judged sample the agent first wrote the rule down. The authors argue that persistence-driven risks need to be evaluated because violations of rules placed in the environment without user oversight can lead to serious incidents.

by read1 min views1 publishedNov 16, 2026

arXiv:2611.17460v1 Announce Type: new Abstract: AI agents are increasingly equipped with persistence toward task completion to run delegated work autonomously for long periods, under many unstated constraints from internal documents and other people's authority. When completion requires violating a rule, the agent must decide alone, yet benchmarks of instruction-rule conflicts state the rule in the prompt or keep it hidden and do not evaluate persistence. We present Unfinished-Bench, a benchmark that gives models persistence in autonomous runs without a user, in realistic work environments with embedded rules. In each of its 97 scenarios across 7 organizations and 7 risk categories, the goal and the rule cannot both hold. We find that persistence raised violations of a rule in an internal document from 32.2% to 43.6%, five times the 8.5% for the same rule stated by the user. Of the document-rule violations, 98.3% occurred after the rule was displayed, and in 89% of a judged sample the agent first wrote down the rule. Violations of rules placed in the environment without user oversight can lead to serious incidents, so persistence-driven risks need to be evaluated. Benchmark documentation: https://francis21c.github.io/unfinished-bench/

── more in #ai-agents 4 stories · sorted by recency
── more on @unfinished-bench 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/unfinished-bench-mea…] indexed:0 read:1min 2026-11-16 · —