{"slug": "stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study", "title": "Stronger LLMs Follow Conflicting Instructions More Literally | barkup-bench Study Z", "summary": "A new benchmark study, Study Z, found that stronger large language models follow conflicting instructions more literally, picking the most literal reading when a standing rule collides with a user request. The study tested three models across 216 facts and rules with zero cross-client contamination, but the headline finding was later inverted by a pre-registered confirmation study.", "body_md": "Correction, July 13: the headline finding did not survive its own pre-registered confirmation study. Study AA inverted it, and the foreword explains what happened. The original post follows unchanged. Study Z, the twenty-sixth in our pre-registered benchmark series, finally measured the thing almost every AI document editor does without evidence: shipping a standing context block with every request. Company background, client records, a twelve-rule styleguide. Does the model actually use it? The answer is a clean yes: 216 of 216 on facts and rules across three models, zero cross-client contamination in 324 cells, and no burial effect anywhere in the styleguide. The hazard we found instead lives in the styleguide itself. When a standing rule collides with what the user asked for, models don't break either one. They pick a reading. And the strongest model picks the most literal reading most often.", "url": "https://wpnews.pro/news/stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study", "canonical_source": "https://www.lightningjar.com/blog/stronger-llms-follow-conflicting-instructions-more-literally", "published_at": "2026-07-13 15:51:29.154689+00:00", "updated_at": "2026-07-13 15:51:31.432774+00:00", "lang": "en", "topics": ["large-language-models", "ai-research"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study", "markdown": "https://wpnews.pro/news/stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study.md", "text": "https://wpnews.pro/news/stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study.txt", "jsonld": "https://wpnews.pro/news/stronger-llms-follow-conflicting-instructions-more-literally-barkup-bench-study.jsonld"}}