{"slug": "llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations", "title": "LLMs recognize dropout and Gaussian noise applied to their activations", "summary": "A paper posted to arXiv on 19 April 2026 by Damiano Fornasiere reports that eight language models from the Gemma, Llama, Mistral, Olmo, Qwen and Seed families, sized between 8B and 36B parameters, can detect and localize dropout or Gaussian noise applied to their activations at a target sentence, often with perfect accuracy on multiple-choice questions such as \"Which of the previous sentences was perturbed?\" The study finds Olmo models develop the capacity during pre-training and rules out lower log-likelihood of perturbed sentences as the explanation, while zero-shot accuracy at identifying which perturbation was applied correlates with perturbation strength for Qwen3-32B and Qwen3.8-27B. The authors discuss a possible data-agnostic \"training awareness\" signal and its implications for AI safety, noting dropout is used in training regularization while Gaussian noise is sometimes added at inference.", "body_md": "# Computer Science > Artificial Intelligence\n\n  [Submitted on 19 Apr 2026 (\n\n[v1](https://arxiv.org/abs/2604.17465v1)), last revised 14 Oct 2026 (this version, v3)]\n# Title:Language models recognize dropout and Gaussian noise applied to their activations\n\n[View PDF](https://arxiv.org/pdf/2604.17465)\n\nAbstract:We provide evidence that language models can detect, localize and, to a degree, verbalize the difference between a-semantic perturbations applied to their activations. More precisely, we either (a) apply dropout or (b) add Gaussian noise to them, at a target sentence. We then ask a multiple-choice question such as \"Which of the previous sentences was perturbed?\" or \"Which perturbation was applied?\". We test eight models from the Gemma, Llama, Mistral, Olmo, Qwen and Seed families, with sizes between 8B and 36B, all of which can easily detect and localize the perturbations, often with perfect accuracy. To investigate the mechanisms, we find that Olmo models develop this capacity during pre-training, and we rule out the hypothesis that perturbed sentences simply have lower log-likelihood. Notably, the zero-shot accuracy of Qwen3-32B and Qwen3.8-27B in identifying which perturbation was applied correlates with the perturbation strength. While this task proves hard for the remaining models, most of them can learn, when taught in context, to distinguish between dropout and Gaussian noise. Interestingly, Qwen3-32B and Qwen3.8-27B learn worse when supervised with wrong labels, again suggesting a prior towards the correct ones. Because dropout is used as a training-regularization technique, while Gaussian noise is sometimes added during inference, we discuss the possibility of a data-agnostic \"training awareness\" signal and the implications for AI safety.\n    \n\n## Submission history\n\nFrom: Damiano Fornasiere [\n[view email](https://arxiv.org/show-email/0b81ff33/2604.17465)]\n\n**Sun, 19 Apr 2026 14:30:13 UTC (94 KB)**\n\n[\\[v1\\]](https://arxiv.org/abs/2604.17465v1)\n**Thu, 30 Apr 2026 22:17:02 UTC (94 KB)**\n\n[\\[v2\\]](https://arxiv.org/abs/2604.17465v2)\n**[v3]** Wed, 14 Oct 2026 19:43:24 UTC (6,905 KB)\n\n### Additional Features\n\n### References & Citations\n\nLoading...\n\n# Bibliographic and Citation Tools\n\nBibliographic Explorer \n\n*(*[What is the Explorer?](https://info.arxiv.org/labs/showcase.html#arxiv-bibliographic-explorer))\nConnected Papers \n\n*(*[What is Connected Papers?](https://www.connectedpapers.com/about))\nLitmaps \n\n*(*[What is Litmaps?](https://www.litmaps.co/))\nscite Smart Citations \n\n*(*[What are Smart Citations?](https://www.scite.ai/))\n# Code, Data and Media Associated with this Article\n\nalphaXiv \n\n*(*[What is alphaXiv?](https://alphaxiv.org/))\nCatalyzeX Code Finder for Papers \n\n*(*[What is CatalyzeX?](https://www.catalyzex.com))\nDagsHub \n\n*(*[What is DagsHub?](https://dagshub.com/))\nGotit.pub \n\n*(*[What is GotitPub?](http://gotit.pub/faq))\nHugging Face \n\n*(*[What is Huggingface?](https://huggingface.co/huggingface))\nScienceCast \n\n*(*[What is ScienceCast?](https://sciencecast.org/welcome))\n# Demos\n\n# Recommenders and Search Tools\n\nInfluence Flower \n\n*(*[What are Influence Flowers?](https://influencemap.cmlab.dev/))\nCORE Recommender \n\n*(*[What is CORE?](https://core.ac.uk/services/recommender))\n# arXivLabs: experimental projects with community collaborators\n\narXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.\n\nBoth individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.\n\nHave an idea for a project that will add value for arXiv's community? [**Learn more about arXivLabs**](https://info.arxiv.org/labs/index.html).", "url": "https://wpnews.pro/news/llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations", "canonical_source": "https://arxiv.org/abs/2604.17465", "published_at": "2026-10-30 08:43:17+00:00", "updated_at": "2026-10-30 09:16:54.490350+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-safety", "machine-learning"], "entities": ["arXiv", "Damiano Fornasiere", "Gemma", "Llama", "Mistral", "Olmo", "Qwen", "Seed"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations", "markdown": "https://wpnews.pro/news/llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations.md", "text": "https://wpnews.pro/news/llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations.txt", "jsonld": "https://wpnews.pro/news/llms-recognize-dropout-and-gaussian-noise-applied-to-their-activations.jsonld"}}