{"slug": "wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays", "title": "WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays", "summary": "Researchers developed WrAFT, a modular automated writing evaluation system for argumentative essays that uses large language models including LLaMA-3.3-70B-Instruct, GPT-4o, and Claude 3.7. The system achieved state-of-the-art scoring performance with a quadratic weighted kappa of 0.84 and high human approval ratings for feedback, and is publicly available as a free interactive tool.", "body_md": "arXiv:2607.14524v1 Announce Type: new\nAbstract: This study presents WrAFT, a Writing Assessment and Feedback Tool, that delivers both accurate and reliable scores and effective comprehensive feedback to argumentative essays. WrAFT adopts a modular design by dividing automated writing evaluation (AWE) tasks into scoring, surface-level feedback, and deep-level feedback. In building the system, various Large Language Models (LLMs) have been evaluated, including LLaMA-3.3-70B-Instruct, GPT-4o, and Claude 3.7, through both direct prompting and supervised fine-tuning approaches. A proprietary dataset of 480 TOEFL Independent Writing essays with official benchmark scores was utilized. Benchmark-based evaluation shows that WrAFT achieves state-of-the-art performance in scoring, with a quadratic weighted kappa (QWK) of 0.84 and a root mean square error (RMSE) of 0.44 against official scores on a scale of 0-5. Human evaluation of system-generated feedback also reveals high approval ratings: 96.14 percent for surface-level feedback, 93.03 percent for deep-level macro feedback, and 94.69 percent for deep-level micro feedback. An interactive user interface has been developed for the system and is publicly available and free to use.", "url": "https://wpnews.pro/news/wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays", "canonical_source": "https://www.machinebrief.com/news/wraft-a-modularized-automated-writing-evaluation-system-for-wdb0", "published_at": "2026-07-17 04:00:00+00:00", "updated_at": "2026-07-17 05:02:48.422438+00:00", "lang": "en", "topics": ["large-language-models", "artificial-intelligence", "natural-language-processing", "ai-tools"], "entities": ["WrAFT", "LLaMA-3.3-70B-Instruct", "GPT-4o", "Claude 3.7", "TOEFL"], "alternates": {"html": "https://wpnews.pro/news/wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays", "markdown": "https://wpnews.pro/news/wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays.md", "text": "https://wpnews.pro/news/wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays.txt", "jsonld": "https://wpnews.pro/news/wraft-a-modularized-automated-writing-evaluation-system-for-argumentative-essays.jsonld"}}