5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control

Researchers introduced 5ting, a system for the SemEval-2026 Task 8 (MTRAGEval) that combines BGE-M3 dense retrieval, FAISS indexing, dual-query merged retrieval, and LLM-based reranking with role-separated generation constrained to retrieved evidence. The retriever achieved nDCG@5 of 0.4719 in Task A, and the end-to-end system ranked in Task C with a harmonic score of 0.5597 and RL_F of 0.7692.

Computer Science Computation and Language Submitted on 27 Jun 2026 Title:5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control View PDF /pdf/2606.28737 HTML experimental https://arxiv.org/html/2606.28737v1 Abstract:We introduce 5ting, our system for the SemEval2026 Task 8 MTRAGEval , which evaluates multi-turn Retrieval Augmented Generation RAG systems. Multi turn RAG involves context drift, under specification, and hallucination risk. Our system combines BGE-M3 dense retrieval with FAISS indexing, dual-query merged retrieval, and LLM based reranking, followed by role separated generation constrained to retrieved evidence. The retriever achieved nDCG@5 = 0.4719 in Task A, while the end to end system ranked in Task C with a harmonic score of 0.5597 and RL F = 0.7692. Submission history From: Thien-Qua T.Nguyen view email /show-email/ac788e84/2606.28737 v1 Sat, 27 Jun 2026 05:13:49 UTC 326 KB References & Citations Loading... Bibliographic and Citation Tools Bibliographic Explorer What is the Explorer? https://info.arxiv.org/labs/showcase.html arxiv-bibliographic-explorer Connected Papers What is Connected Papers? https://www.connectedpapers.com/about Litmaps What is Litmaps? https://www.litmaps.co/ scite Smart Citations What are Smart Citations? https://www.scite.ai/ Code, Data and Media Associated with this Article alphaXiv What is alphaXiv? https://alphaxiv.org/ CatalyzeX Code Finder for Papers What is CatalyzeX? https://www.catalyzex.com DagsHub What is DagsHub? https://dagshub.com/ Gotit.pub What is GotitPub? http://gotit.pub/faq Hugging Face What is Huggingface? https://huggingface.co/huggingface ScienceCast What is ScienceCast? https://sciencecast.org/welcome Demos Recommenders and Search Tools Influence Flower What are Influence Flowers? https://influencemap.cmlab.dev/ CORE Recommender What is CORE? https://core.ac.uk/services/recommender arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs https://info.arxiv.org/labs/index.html .