{"slug": "behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of", "title": "Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback", "summary": "Céline Leuzinger published a study in the Proceedings of the 15th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2026, pages 269–287, Gothenburg, Sweden) examining cross-LLM bias and reasoning contradictions when large language models act as judges of generated feedback. The paper, titled \"Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback,\" was released through the University of Tartu Library and is available via the ACL Anthology (2026.nlp4call-1.20). The work matters because LLM-as-a-judge setups are widely used to evaluate generated feedback, and the study documents bias and contradictions across models that undermine that evaluation method.", "body_md": "- Anthology ID:\n- 2026.nlp4call-1.20\n- Volume:\n- [Proceedings of the 15th Workshop on Natural Language Processing for Computer Assisted Language Learning](https://aclanthology.org/volumes/2026.nlp4call-1/)\n- Month:\n- November\n- Year:\n- 2026\n- Address:\n- Gothenburg, Sweden\n- Editors:\n- [Arianna Masciolini](https://aclanthology.org/people/arianna-masciolini/) ,[David Alfter](https://aclanthology.org/people/david-alfter/) ,[Herbert Lange](https://aclanthology.org/people/herbert-lange/) ,[Ricardo Muñoz Sánchez](https://aclanthology.org/people/ricardo-munoz-sanchez/) ,[Ildikó Pilán](https://aclanthology.org/people/ildiko-pilan/unverified/) ,[Elena Volodina](https://aclanthology.org/people/elena-volodina/)\n- Venues:\n- [NLP4CALL](https://aclanthology.org/venues/nlp4call/) |[WS](https://aclanthology.org/venues/ws/)\n- SIG:\n- [SIGEDU](https://aclanthology.org/sigs/sigedu/)\n- Publisher:\n- University of Tartu Library\n- Note:\n- Pages:\n- 269–287\n- Language:\n- URL:\n- [https://aclanthology.org/2026.nlp4call-1.20/](https://aclanthology.org/2026.nlp4call-1.20/)\n- DOI:\n- Cite (ACL):\n- Céline Leuzinger. 2026. [Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback](https://aclanthology.org/2026.nlp4call-1.20/) . In*Proceedings of the 15th Workshop on Natural Language Processing for Computer Assisted Language Learning* , pages 269–287, Gothenburg, Sweden. University of Tartu Library.\n- Cite (Informal):\n- [Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback](https://aclanthology.org/2026.nlp4call-1.20/) (Leuzinger, NLP4CALL 2026)\n- PDF:\n- [https://aclanthology.org/2026.nlp4call-1.20.pdf](https://aclanthology.org/2026.nlp4call-1.20.pdf)", "url": "https://wpnews.pro/news/behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of", "canonical_source": "https://aclanthology.org/2026.nlp4call-1.20/", "published_at": "2026-11-05 00:00:00+00:00", "updated_at": "2026-11-10 15:21:43.345962+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "natural-language-processing", "ai-safety"], "entities": ["Céline Leuzinger", "NLP4CALL", "University of Tartu Library", "ACL Anthology", "Gothenburg, Sweden"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of", "markdown": "https://wpnews.pro/news/behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of.md", "text": "https://wpnews.pro/news/behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of.txt", "jsonld": "https://wpnews.pro/news/behind-the-smokescreen-uncovering-cross-llm-bias-and-reasoning-contradictions-of.jsonld"}}