{"slug": "reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic", "title": "ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews", "summary": "Researchers developed ReviewPilot, a conversational multi-agent system that automates the PRISMA systematic review workflow from paper screening to information extraction, according to an arXiv paper (arXiv:2610.21042v1). On epidemiological expert reviews, ReviewPilot outperformed a single-prompt LLM and AgentSLR across three LLMs, reaching screening macro F1 up to 0.776 and extraction F1 up to 0.788, with each screening decision recording its reason and each extracted value its source. Case studies in biomedicine and human-computer interaction showed close agreement with human annotators, and the code is available at https://github.com/ZhaoqianXue/ReviewPilot.", "body_md": "arXiv:2610.21042v1 Announce Type: new \nAbstract: Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at https://github.com/ZhaoqianXue/ReviewPilot.", "url": "https://wpnews.pro/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic", "canonical_source": "https://www.machinebrief.com/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extr-wyy2", "published_at": "2026-10-16 04:00:00+00:00", "updated_at": "2026-10-16 05:08:43.355720+00:00", "lang": "en", "topics": ["ai-agents", "large-language-models", "ai-research", "natural-language-processing"], "entities": ["ReviewPilot", "AgentSLR", "arXiv", "PRISMA", "ZhaoqianXue"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic", "markdown": "https://wpnews.pro/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic.md", "text": "https://wpnews.pro/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic.txt", "jsonld": "https://wpnews.pro/news/reviewpilot-a-multi-agent-system-for-screening-and-data-extraction-in-systematic.jsonld"}}