A Quantitative Approach to Asch Conformity in Frontier Large Language Models

A new arXiv paper (2610.36668v1) reports that frontier large language models do exhibit Asch-style conformity, with the authors quantifying the effect by repeatedly sampling a single question to build answer distributions before and after the model is shown a manufactured consensus. The distribution-to-distribution comparison adds quantitative detail on the conditions that produce conformity and how strong it is, reinforcing prior literature that had mainly demonstrated the phenomenon's existence.

arXiv:2610.36668v1 Announce Type: new Abstract: The Asch conformity experiment has recently gained considerable attention as a way of measuring conformity in large language models LLMs . While previous studies have focused on demonstrating conformity in LLMs, our work adds a further quantitative layer to this approach. Instead of sampling a frontier LLM on a suite of questions, our approach samples a single question repeatedly, leveraging the probabilistic nature of LLMs to produce a distribution of answers. In doing so, we can compare the distributions of answers before and after the model is presented with the manufactured consensus. Our experiments confirm that frontier LLMs do conform, reinforcing prior literature, and, through our distribution-to-distribution comparisons, provide additional quantitative data on the conditions that lead to conformity and the degree to which it occurs.