{"slug": "evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of", "title": "Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing", "summary": "A study of 23 student projects in a fourth-year Machine Translation and Post-editing course found that students did not treat automatic metrics as final authority when selecting machine translation output for post-editing, according to a paper by Gokhan Dogru published in the Proceedings of the 1st International Workshop on Teaching AI-Based Translation and Technologies (TAITT 2026). Students translated short specialised English Wikipedia texts into Catalan or Spanish, generated four system outputs, evaluated them with automatic metrics and human adequacy/fluency assessment, then justified their post-editing choice in written reports; final selections often diverged from metric rankings and were justified through adequacy, fluency, terminology, and expected post-editing effort. The analysis combined descriptive counts from all 23 projects with qualitative coding of the 22 cases supported by written reports, and the paper appears in the TAITT 2026 proceedings, pages 36–48, published by the European Association for Machine Translation in Tilburg, the Netherlands, in June 2026.", "body_md": "##### Abstract\n\nDrawing on 23 student projects from a fourth-year Machine Translation and Post-editing course, this paper examines how asking students to compare LLM and NMT outputs, interpret metric results, and justify a post-editing choice reveals their evaluative judgement. Students translated short specialised English Wikipedia texts into Catalan or Spanish, generated four system outputs, evaluated them using automatic metrics and human adequacy/fluency assessment, selected one output for post-editing, and justified their decision in written reports. The analysis combines descriptive counts from 23 projects with qualitative coding of the 22 cases sup-ported by written reports. Results show that students did not treat automatic metrics as final authority: final post-editing selections often diverged from metric rankings and were justified through adequacy, fluency, terminology, and expected post-editing effort. The study therefore does not compare systems under benchmark conditions; it analyses how students justified system choice within an au-thentic classroom assignment.\n- Anthology ID:\n- 2026.taitt-1.5\n- Volume:\n- [Proceedings of the 1st International Workshop on Teaching AI-Based Translation and Technologies (TAITT 2026)](https://aclanthology.org/volumes/2026.taitt-1/)\n- Month:\n- June\n- Year:\n- 2026\n- Address:\n- Tilburg, the Netherlands\n- Editors:\n- [Ralph Krüger](https://aclanthology.org/people/ralph-kruger/unverified/) ,[Dorothy Kenny](https://aclanthology.org/people/dorothy-kenny/unverified/) ,[Sheila Castilho](https://aclanthology.org/people/sheila-castilho/unverified/) ,[Sergi Álvarez-Vidal](https://aclanthology.org/people/sergi-alvarez-vidal/) ,[Nora Aranberri](https://aclanthology.org/people/nora-aranberri/unverified/) ,[María Isabel Rivas Ginel](https://aclanthology.org/people/maria-isabel-rivas-ginel/unverified/) ,[Janiça Hackenbuchner](https://aclanthology.org/people/janica-hackenbuchner/)\n- Venues:\n- [TAITT](https://aclanthology.org/venues/taitt/) |[WS](https://aclanthology.org/venues/ws/)\n- SIG:\n- Publisher:\n- European Association for Machine Translation\n- Note:\n- Pages:\n- 36–48\n- Language:\n- URL:\n- [https://aclanthology.org/2026.taitt-1.5/](https://aclanthology.org/2026.taitt-1.5/)\n- DOI:\n- Cite (ACL):\n- Gokhan Dogru. 2026. [Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing](https://aclanthology.org/2026.taitt-1.5/) . In*Proceedings of the 1st International Workshop on Teaching AI-Based Translation and Technologies (TAITT 2026)* , pages 36–48, Tilburg, the Netherlands. European Association for Machine Translation.\n- Cite (Informal):\n- [Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing](https://aclanthology.org/2026.taitt-1.5/) (Dogru, TAITT 2026)\n- PDF:\n- [https://aclanthology.org/2026.taitt-1.5.pdf](https://aclanthology.org/2026.taitt-1.5.pdf)", "url": "https://wpnews.pro/news/evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of", "canonical_source": "https://aclanthology.org/2026.taitt-1.5/", "published_at": "2026-09-17 00:00:00+00:00", "updated_at": "2026-09-22 17:54:38.953847+00:00", "lang": "en", "topics": ["machine-learning", "natural-language-processing", "ai-research"], "entities": ["Gokhan Dogru", "TAITT 2026", "European Association for Machine Translation", "Catalan", "Spanish", "Wikipedia"], "alternates": {"html": "https://wpnews.pro/news/evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of", "markdown": "https://wpnews.pro/news/evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of.md", "text": "https://wpnews.pro/news/evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of.txt", "jsonld": "https://wpnews.pro/news/evaluative-judgement-in-teaching-ai-based-translation-a-class-room-case-study-of.jsonld"}}