cd /news/natural-language-processing/shortcuts-or-memorisation-revisiting… · home › topics › natural-language-processing › article
[ARTICLE · art-173080] src=machinebrief.com ↗ pub= topic=natural-language-processing verified=true sentiment=· neutral

Shortcuts or Memorisation? Revisiting Data Corruption in Natural Language Understanding with Large Language Models

A study of eight large language models and fine-tuned encoders on GLUE and the three rounds of ANLI found that every system answering directly retains 36-72% of its above-chance performance without nouns on MNLI, versus only 14-29% on ANLI, according to the arXiv paper 2611.16843v2. The authors report no link between pre-training exposure and robustness after checking contamination indicators, including exact n-gram counts in the public pre-training data of two models, and cite 368 new human-validated items unseen by any model on which all eight LLMs kept more performance without nouns on MNLI-style items than on items lacking its cues. The authors conclude that robustness to perturbation on familiar NLI benchmarks reflects dataset shortcuts rather than memorisation, and says more about the benchmark than the model.

recommendation

Test models on human-written items that lack the benchmark's stylistic cues, not just perturbed benchmark inputs, since MNLI-style wording inflated noun-drop robustness across all eight LLMs.

more in playbook: Evals and testing for LLM apps
by read1 min views2 publishedNov 20, 2026

arXiv:2611.16843v2 Announce Type: replace Abstract: Pre-trained encoders fine-tuned on natural language inference (NLI) and other language understanding tasks keep much of their accuracy after the input is perturbed, e.g. by removing all nouns or shuffling the words. Does the same hold for large language models (LLMs), and if so, is it because they have seen the benchmarks during pre-training? In this paper we revisit these perturbation experiments with eight LLMs alongside fine-tuned encoders on GLUE and the three rounds of ANLI. Regardless of model size, every system that answers directly retains 36-72% of its above-chance performance without nouns on MNLI compared to only 14-29% on ANLI. Only a model that reasons before answering departs from this pattern. We also check contamination indicators (including exact $n$-gram counts in the public pre-training data of two of the models) and find no link between exposure and robustness. Our strongest evidence comes from 368 new, human-validated items that none of the models can have seen. All eight LLMs keep more of their performance without nouns on items written in MNLI's style than on items written without its cues. When the perturbation instead removes the function words carrying such cues, this advantage reverses. In light of these results, we argue that robustness to perturbation on familiar NLI benchmarks reflects dataset shortcuts rather than memorisation, and tells us more about the benchmark than about the model.

── more in #natural-language-processing 4 stories · sorted by recency
── more on @glue 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/shortcuts-or-memoris…] indexed:0 read:1min 2026-11-20 · —