Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged
A new arXiv paper (2610.10918v1) evaluating large language models for machine translation quality annotation found that LLM agreement with human annotators exceeds inter-human agreement on some tasks but remains unreliab…