cd /news/large-language-models/seduced-by-the-narrative-assessing-r… · home topics large-language-models article
[ARTICLE · art-48860] src=arxiv.org ↗ pub= topic=large-language-models verified=true sentiment=· neutral

Seduced by the Narrative: Assessing Rule Adherence in Semi-Open Textual Sandboxes

Researchers introduced CoC-Seduce, a benchmark for testing LLM rule adherence in semi-open textual environments, revealing that frontier models like GPT-5.4, Claude Sonnet 4.6, and Gemini 3.5 Flash are vulnerable to Rhetorical Injection attacks. The study found that neither model scale nor explicit reasoning mechanisms ensure robustness, with pseudo-logic being the dominant attack vector and cross-cultural settings exposing knowledge gaps.

read1 min views1 publishedJul 7, 2026

arXiv:2607.02802v1 Announce Type: new Abstract: As LLMs are increasingly deployed as autonomous adjudicators in semi-open textual game environments, robust rule adherence becomes critical when user intent conflicts with system rules. However, these models are trained to be helpful and compliant, leaving them vulnerable to a class of attacks we term \textit{Rhetorical Injection}, where adversarial users exploit narrative framing techniques such as pseudo-logical reasoning and authoritative coercion to bypass adjudication logic. We present CoC-Seduce, a multi-agent adversarial benchmark built on Tabletop Role-Playing Game (TRPG) mechanics, an ideal instantiation of semi-open environments where rules are explicit for adjudication, yet interaction remains entirely in natural language. Three frontier models, i.e., GPT-5.4, Claude Sonnet 4.6, Gemini 3.5 Flash, serve as adversarial generators producing 5,376 samples across 4 world settings and 16 skill categories. We then benchmark 20 target adjudicators against this corpus. Evaluation across 20 models reveals that neither model scale nor explicit reasoning mechanisms reliably confer adjudication robustness, with \textsc{Pseudo-Logic} emerging as the dominant attack vector and cross-cultural settings exposing systematic knowledge gaps across all evaluated families. Project page: https://github.com/answerrtx/CoC-Seduce

── more in #large-language-models 4 stories · sorted by recency
── more on @gpt-5.4 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/seduced-by-the-narra…] indexed:0 read:1min 2026-07-07 ·