{"slug": "tusi-a-citation-grounded-graph-based-benchmark", "title": "TUSI: A Citation-Grounded Graph-Based Benchmark", "summary": "Researchers introduced TUSI-Bench, a Persian legal benchmark for evaluating retrieval-augmented generation systems, built on a multi-layered framework of 7,261 legal articles spanning codified statutes, legal commentaries, doctrinal writings and Supreme Court unification rulings. TUSI-Bench comprises TUSI-QA, 1,999 open-ended questions requiring grounded answers with explicit legal citations, and TUSI-Bar, roughly 500 four-option multiple-choice questions drawn from Iranian Bar examination questions, alongside a legal knowledge graph linking articles and concepts. A proposed graph-based retrieval baseline that exploits the knowledge graph's relational structure improved retrieval recall by up to 8 percentage points over standard baselines, according to the arXiv paper 2611.21823v1.", "body_md": "arXiv:2611.21823v1 Announce Type: new \nAbstract: Evaluating retrieval-augmented generation (RAG) systems in Persian law remains challenging because benchmarks lack realism, grounding, and coverage of legal reasoning. Existing resources are either synthetically generated from statutory texts, lacking natural information needs, or derived from informal legal question--answer sources without explicit linkage to authoritative legal documents, making them unsuitable for rigorous evaluation of grounded legal reasoning. To address this gap, we introduce TUSI-Bench, a structured Persian legal benchmark designed for the evaluation of RAG-based systems. TUSI-Bench is built upon a multi-layered legal knowledge framework containing 7,261 legal articles and integrating codified statutes, legal commentaries, doctrinal writings, and Supreme Court unification rulings. We also construct a legal knowledge graph linking articles and concepts for structure-aware retrieval. Based on this foundation, TUSI-Bench provides two complementary evaluation tasks: (i) TUSI-QA, an open-ended question answering benchmark containing 1,999 questions that requires grounded responses with explicit legal citations, and (ii) TUSI-Bar, a multiple-choice benchmark containing approximately 500 four-option questions derived from Iranian Bar examination questions. Furthermore, we propose a graph-based retrieval baseline that leverages relational structure within the legal knowledge graph. Experimental results demonstrate that incorporating graph-based relations improves retrieval recall by up to 8 percentage points compared to standard baselines, highlighting the importance of structured legal representations for RAG systems. The proposed benchmark provides a standardized resource for evaluating grounded legal reasoning in Persian and enables future research on structured legal intelligence.", "url": "https://wpnews.pro/news/tusi-a-citation-grounded-graph-based-benchmark", "canonical_source": "https://www.machinebrief.com/news/tusi-a-citation-grounded-graph-based-benchmark-lydf", "published_at": "2026-11-18 05:00:00+00:00", "updated_at": "2026-11-18 05:15:58.899899+00:00", "lang": "en", "topics": ["ai-research", "large-language-models", "natural-language-processing"], "entities": ["TUSI-Bench", "TUSI-QA", "TUSI-Bar", "arXiv", "Iranian Bar examination", "Supreme Court"], "also_reported_by": [], "takeaway": "Adding knowledge-graph relations to retrieval raised recall by up to 8 percentage points over standard baselines on the 7,261-article Persian legal corpus.", "recommendation": {"advice": "Link legal articles and concepts in a knowledge graph and retrieve over its relational structure; the source measured up to 8 percentage points higher recall than standard baselines.", "playbook": "rag-retrieval", "playbook_url": "https://wpnews.pro/playbooks/rag-retrieval"}, "alternates": {"html": "https://wpnews.pro/news/tusi-a-citation-grounded-graph-based-benchmark", "markdown": "https://wpnews.pro/news/tusi-a-citation-grounded-graph-based-benchmark.md", "text": "https://wpnews.pro/news/tusi-a-citation-grounded-graph-based-benchmark.txt", "jsonld": "https://wpnews.pro/news/tusi-a-citation-grounded-graph-based-benchmark.jsonld"}}