cd /news/large-language-models/behind-the-smokescreen-uncovering-cr… · home › topics › large-language-models › article
[ARTICLE · art-167018] src=aclanthology.org ↗ pub= topic=large-language-models verified=true sentiment=· neutral

Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback

Céline Leuzinger published a study in the Proceedings of the 15th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2026, pages 269–287, Gothenburg, Sweden) examining cross-LLM bias and reasoning contradictions when large language models act as judges of generated feedback. The paper, titled "Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback," was released through the University of Tartu Library and is available via the ACL Anthology (2026.nlp4call-1.20). The work matters because LLM-as-a-judge setups are widely used to evaluate generated feedback, and the study documents bias and contradictions across models that undermine that evaluation method.

read1 min views1 publishedNov 5, 2026
Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback
Image: Aclanthology (auto-discovered)
- Anthology ID:
- 2026.nlp4call-1.20
- Volume:
- Venues:
- [NLP4CALL](https://aclanthology.org/venues/nlp4call/) |[WS](https://aclanthology.org/venues/ws/)
- SIG:
- [SIGEDU](https://aclanthology.org/sigs/sigedu/)
- Publisher:
  • University of Tartu Library
- Note:
- Pages:
  • 269–287
- Language:
- URL:
- [https://aclanthology.org/2026.nlp4call-1.20/](https://aclanthology.org/2026.nlp4call-1.20/)
- DOI:
- Cite (ACL):
- Cite (Informal):
- [Behind the Smokescreen: Uncovering Cross-LLM Bias and Reasoning Contradictions of LLM-as-a-judge for Generated Feedback](https://aclanthology.org/2026.nlp4call-1.20/) (Leuzinger, NLP4CALL 2026)
- PDF:
- [https://aclanthology.org/2026.nlp4call-1.20.pdf](https://aclanthology.org/2026.nlp4call-1.20.pdf)
── more in #large-language-models 4 stories · sorted by recency
── more on @céline leuzinger 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/behind-the-smokescre…] indexed:0 read:1min 2026-11-05 · —