cd /news/ai-safety/persuasion-attacks-can-decrease-effe… · home topics ai-safety article
[ARTICLE · art-53636] src=arxiv.org ↗ pub= topic=ai-safety verified=true sentiment=↓ negative

Persuasion Attacks Can Decrease Effectiveness of CoT Monitoring

Researchers found that chain-of-thought monitoring of AI agents can be counterproductive under adversarial persuasion attacks, increasing approval of harmful actions by 9.5%. A fact-checking framework using different model families for monitoring and fact-checking reduced policy violations by up to 45%.

read1 min views1 publishedJul 10, 2026

arXiv:2607.08066v1 Announce Type: new Abstract: Chain-of-thought (CoT) monitoring is a promising safety mechanism for AI agents, based on the premise that visible reasoning traces can surface misaligned or deceptive behavior. While effective in standard scenarios, recent work highlights that LLMs remain vulnerable to persuasion-based jailbreaks, where natural-language arguments override model constraints. We stress-test whether this vulnerability extends to monitoring LLMs: can an adversarial agent persuade its CoT monitor to approve proposed actions that violate the monitor's policy? We design an evaluation framework with 40 tasks and analyze thousands of agent-monitor interactions, where agents are instructed to argue for policy-violating proposals. We find that in such adversarial settings, monitor access to the agent's CoT reasoning increases rather than decreases approval of harmful actions on average by 9.5%, as the scratchpad provides an additional persuasion channel. To address this, we introduce a fact-checking monitoring framework. We find that a fact-checker and monitor pairing from different model families, for example a Claude 3.7 Sonnet monitor paired with a GPT-4.1 fact-checker, reduces approval of policy-violating actions by up to 45%, compared to only 6%, when using the same model for both fact-checking and monitoring roles. Our results demonstrate that CoT monitoring alone may be insufficient against adversarial persuasion, and that model-diverse fact-checking provides a robust mitigation.

── more in #ai-safety 4 stories · sorted by recency
── more on @claude 3.7 sonnet 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/persuasion-attacks-c…] indexed:0 read:1min 2026-07-10 ·