{"slug": "fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable", "title": "FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection", "summary": "Researchers propose FCPRAG, a fusion-controlled parametric retrieval-augmented generation framework that adds a lightweight controller for sample-level adapter fusion, improving multi-passage LoRA injection stability. On HotpotQA, 2WikiMultiHopQA, PopQA, and ComplexWebQuestions across three LLM backbones, FCPRAG improves F1 by up to 4.65% on 2WikiMultiHopQA and 7.55% on CWQ over standard RAG and parametric RAG baselines, while reducing tuning cost and improving robustness.", "body_md": "arXiv:2608.21750v1 Announce Type: new\nAbstract: Parametric retrieval-augmented generation (PRAG) injects retrieved evidence into a large language model (LLM) through passage-specific LoRA adapters, reducing reliance on long in-context prompts. When multiple passages are retrieved for the same query, however, evidence-level fusion becomes a bottleneck: equal-weight merging can amplify weak or conflicting evidence, and translating retrieval signals into fusion weights often requires fragile global tuning. We propose FCPRAG, a fusion-controlled parametric RAG framework that adds a lightweight controller for retrieval-conditioned, sample-level adapter fusion. The controller predicts per-passage fusion scores together with sample-level calibration signals, including a mixing gate and an adaptive temperature, enabling fusion that stays selective under informative retrieval signals and conservative under uncertainty. FCPRAG is trained with merge-aware supervision derived from each adapter's marginal contribution within a multi-adapter merge, using training data only. We further show that a single dataset-level temperature is suboptimal under heteroscedastic retrieval uncertainty, motivating sample-level adaptation. Experiments on HotpotQA, 2WikiMultiHopQA, PopQA, and ComplexWebQuestions (CWQ) across three LLM backbones show that FCPRAG consistently improves F1 over standard RAG and parametric RAG baselines, with gains of up to 4.65% on 2WikiMultiHopQA and 7.55% on CWQ, while also reducing tuning cost and improving robustness under retrieval perturbations.", "url": "https://wpnews.pro/news/fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable", "canonical_source": "https://arxiv.org/abs/2608.21750", "published_at": "2026-08-25 04:00:00+00:00", "updated_at": "2026-08-25 04:15:28.480755+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research"], "entities": ["FCPRAG", "HotpotQA", "2WikiMultiHopQA", "PopQA", "ComplexWebQuestions", "arXiv"], "alternates": {"html": "https://wpnews.pro/news/fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable", "markdown": "https://wpnews.pro/news/fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable.md", "text": "https://wpnews.pro/news/fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable.txt", "jsonld": "https://wpnews.pro/news/fcprag-fusion-controller-parametric-retrieval-augmented-generation-for-stable.jsonld"}}