{"slug": "evaluating-communicative-belief-updates-in-large-language-models-via-implicature", "title": "Evaluating Communicative Belief Updates in Large Language Models via Implicature Recognition and Cancellation", "summary": "A new study evaluating large language models' ability to recognize unspoken beliefs through implicature recognition and cancellation finds that LLMs lag behind humans, especially in natural scenarios. Researchers created the first expert-annotated implicature cancellation dataset, [DatasetName], and found that LLM successes may rely on prior beliefs while failures depend on type and form. The study concludes that current LLMs have not reached human-level understanding of unspoken beliefs.", "body_md": "arXiv:2607.25094v1 Announce Type: new\nAbstract: Human language is driven by unspoken beliefs and belief updates, making these critical to model for successful communication between large language models (LLMs) and their users. In this paper, we evaluate the ability of LLMs to recognize unspoken beliefs made through implicatures and to understand their updates through implicature cancellation: the pragmatic phenomenon whereby an utterance's implied meaning is weakened or negated. We create the first expert-annotated implicature cancellation dataset, [DatasetName], crowdsourced for human judgements of implicatures and their corresponding cancellations. We find that LLM belief update understanding lags behind that of humans, especially in more naturally-occurring scenarios. Additional control experiments suggest that successes in LLM belief updates may stem in part from a reliance on prior beliefs, and that failures in belief updates may depend on their type and on their form. Overall, our study suggests that current LLMs have not yet reached human-level understanding of unspoken beliefs and belief updates. Code and data are available at https://github.com/cesare-spinoso/ImplicatureX.", "url": "https://wpnews.pro/news/evaluating-communicative-belief-updates-in-large-language-models-via-implicature", "canonical_source": "https://arxiv.org/abs/2607.25094", "published_at": "2026-07-29 04:00:00+00:00", "updated_at": "2026-07-29 04:26:33.962050+00:00", "lang": "en", "topics": ["large-language-models", "natural-language-processing", "ai-research"], "entities": ["arXiv", "DatasetName"], "alternates": {"html": "https://wpnews.pro/news/evaluating-communicative-belief-updates-in-large-language-models-via-implicature", "markdown": "https://wpnews.pro/news/evaluating-communicative-belief-updates-in-large-language-models-via-implicature.md", "text": "https://wpnews.pro/news/evaluating-communicative-belief-updates-in-large-language-models-via-implicature.txt", "jsonld": "https://wpnews.pro/news/evaluating-communicative-belief-updates-in-large-language-models-via-implicature.jsonld"}}