# Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing

> Source: <https://aclanthology.org/2026.taitt-1.5/>
> Published: 2026-09-17 00:00:00+00:00

##### Abstract

Drawing on 23 student projects from a fourth-year Machine Translation and Post-editing course, this paper examines how asking students to compare LLM and NMT outputs, interpret metric results, and justify a post-editing choice reveals their evaluative judgement. Students translated short specialised English Wikipedia texts into Catalan or Spanish, generated four system outputs, evaluated them using automatic metrics and human adequacy/fluency assessment, selected one output for post-editing, and justified their decision in written reports. The analysis combines descriptive counts from 23 projects with qualitative coding of the 22 cases sup-ported by written reports. Results show that students did not treat automatic metrics as final authority: final post-editing selections often diverged from metric rankings and were justified through adequacy, fluency, terminology, and expected post-editing effort. The study therefore does not compare systems under benchmark conditions; it analyses how students justified system choice within an au-thentic classroom assignment.
- Anthology ID:
- 2026.taitt-1.5
- Volume:
- [Proceedings of the 1st International Workshop on Teaching AI-Based Translation and Technologies (TAITT 2026)](https://aclanthology.org/volumes/2026.taitt-1/)
- Month:
- June
- Year:
- 2026
- Address:
- Tilburg, the Netherlands
- Editors:
- [Ralph Krüger](https://aclanthology.org/people/ralph-kruger/unverified/) ,[Dorothy Kenny](https://aclanthology.org/people/dorothy-kenny/unverified/) ,[Sheila Castilho](https://aclanthology.org/people/sheila-castilho/unverified/) ,[Sergi Álvarez-Vidal](https://aclanthology.org/people/sergi-alvarez-vidal/) ,[Nora Aranberri](https://aclanthology.org/people/nora-aranberri/unverified/) ,[María Isabel Rivas Ginel](https://aclanthology.org/people/maria-isabel-rivas-ginel/unverified/) ,[Janiça Hackenbuchner](https://aclanthology.org/people/janica-hackenbuchner/)
- Venues:
- [TAITT](https://aclanthology.org/venues/taitt/) |[WS](https://aclanthology.org/venues/ws/)
- SIG:
- Publisher:
- European Association for Machine Translation
- Note:
- Pages:
- 36–48
- Language:
- URL:
- [https://aclanthology.org/2026.taitt-1.5/](https://aclanthology.org/2026.taitt-1.5/)
- DOI:
- Cite (ACL):
- Gokhan Dogru. 2026. [Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing](https://aclanthology.org/2026.taitt-1.5/) . In*Proceedings of the 1st International Workshop on Teaching AI-Based Translation and Technologies (TAITT 2026)* , pages 36–48, Tilburg, the Netherlands. European Association for Machine Translation.
- Cite (Informal):
- [Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing](https://aclanthology.org/2026.taitt-1.5/) (Dogru, TAITT 2026)
- PDF:
- [https://aclanthology.org/2026.taitt-1.5.pdf](https://aclanthology.org/2026.taitt-1.5.pdf)