{"slug": "document-summarization-for-ai-based-post-editing", "title": "Document Summarization for AI-based Post-Editing", "summary": "Researchers at the Association for Machine Translation in the Americas found that document-level summaries improve AI-based post-editing quality only when they are specific and actionable, with gemini-2.5-flash-lite summaries yielding gains in edit distance and modest COMET gains, while GPT-4o summaries degraded performance across most metrics. The study, presented at AMTA 2026, evaluated nine LLMs from OpenAI and Google across 448 documents, 37 target locales, and 13 content domains, showing the positive effect was most pronounced in terminologically dense domains and lower-resource locales.", "body_md": "[Document Summarization for AI-based Post-Editing](https://aclanthology.org/2026.amta-research.11.pdf)\n\n[Vera Senderowicz Guerra](/people/vera-senderowicz-guerra/unverified/),\n[Dimitrios Pavlou](/people/dimitrios-pavlou/unverified/),\n[Peter Bourgonje](/people/peter-bourgonje/unverified/),\n[Olesia Khrapunova](/people/olesia-khrapunova/unverified/),\n[Konstantinos Karageorgos](/people/konstantinos-karageorgos/unverified/),\n[Aaron Schliem](/people/aaron-schliem/unverified/)\n\n##### Abstract\n\nPost-Editing (PE) is typically performed on isolated segments or small batches, without access to broader document context. In this paper, we investigate whether pre-generated, document-level summaries can improve PE quality. Using a purpose-built summarization prompt evaluated across nine LLMs from OpenAI and Google, we select two models with contrasting summary styles for downstream experiments on 448 documents covering 37 target locales and 13 content domains. Summaries generated by gemini-2.5-flash-lite, which are directive and domain-specific, yield gains in edit distance and modest gains in COMET, whereas those generated by GPT-4o, which tend to be more generic and descriptive, degrade performance across most metrics. The positive effect appears most pronounced in terminologically dense domains and lower-resource locales. A qualitative analysis shows that improvements arise when summaries provide specific, actionable guidance on terminology, domain conventions, and style, and that performance decreases when summaries are underspecified or conflicting. These findings suggest that summary specificity and actionability, rather than the mere addition of context, determine whether document-level information benefits post-editing.- Anthology ID:\n- 2026.amta-research.11\n- Volume:\n[Proceedings of the 17th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)](/volumes/2026.amta-research/)- Month:\n- August\n- Year:\n- 2026\n- Address:\n- Québec City, Canada\n- Editors:\n[Eleftheria Briakou](/people/eleftheria-briakou/unverified/),[Jeremy Gwinnup](/people/jeremy-gwinnup/),[Shivali Goel](/people/shivali-goel/unverified/)- Venue:\n[AMTA](/venues/amta/)- SIG:\n- Publisher:\n- Association for Machine Translation in the Americas\n- Note:\n- Pages:\n- 174–185\n- Language:\n- URL:\n[https://aclanthology.org/2026.amta-research.11/](https://aclanthology.org/2026.amta-research.11/)- DOI:\n- Cite (ACL):\n- Vera Senderowicz Guerra, Dimitrios Pavlou, Peter Bourgonje, Olesia Khrapunova, Konstantinos Karageorgos, and Aaron Schliem. 2026.\n[Document Summarization for AI-based Post-Editing](https://aclanthology.org/2026.amta-research.11/). In*Proceedings of the 17th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)*, pages 174–185, Québec City, Canada. Association for Machine Translation in the Americas. - Cite (Informal):\n[Document Summarization for AI-based Post-Editing](https://aclanthology.org/2026.amta-research.11/)(Guerra et al., AMTA 2026)- PDF:\n[https://aclanthology.org/2026.amta-research.11.pdf](https://aclanthology.org/2026.amta-research.11.pdf)", "url": "https://wpnews.pro/news/document-summarization-for-ai-based-post-editing", "canonical_source": "https://aclanthology.org/2026.amta-research.11/", "published_at": "2026-09-01 00:00:00+00:00", "updated_at": "2026-09-02 11:53:28.667031+00:00", "lang": "en", "topics": ["large-language-models", "natural-language-processing", "ai-research"], "entities": ["OpenAI", "Google", "gemini-2.5-flash-lite", "GPT-4o", "AMTA", "Vera Senderowicz Guerra", "Dimitrios Pavlou", "Peter Bourgonje"], "alternates": {"html": "https://wpnews.pro/news/document-summarization-for-ai-based-post-editing", "markdown": "https://wpnews.pro/news/document-summarization-for-ai-based-post-editing.md", "text": "https://wpnews.pro/news/document-summarization-for-ai-based-post-editing.txt", "jsonld": "https://wpnews.pro/news/document-summarization-for-ai-based-post-editing.jsonld"}}