{"slug": "evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study", "title": "Evaluating RAG for French immigration law: a benchmark and baseline study", "summary": "A new benchmark and baseline study evaluating retrieval-augmented generation (RAG) for French immigration law finds that retrieval improves administrative guidance at both model scales tested. Comparing a parametric LLM baseline against dense retrieval augmentation with Qwen3.5-9B and Qwen3.5-27B on 52 annotated synthetic profiles, the study shows retrieval most notably improves permit-type accuracy. The results confirm that retrieval grounding is important for more reliable administrative guidance in this domain.", "body_md": "arXiv:2607.24449v1 Announce Type: cross\nAbstract: International recruitment in France requires navigating a layered legal framework absent from existing legal AI benchmarks. We present a publicly available benchmark and first comparative evaluation for this domain, covering permit-type recommendation, required-document retrieval, and legal citation coverage. Comparing a parametric LLM baseline against dense retrieval augmentation at two model scales (Qwen3.5-9B and -27B) on 52 annotated synthetic profiles, we find that retrieval improves administrative guidance at both scales, most notably permit-type accuracy. Our results confirm that retrieval grounding is important for more reliable administrative guidance in this domain, and motivate further investigation of hybrid retrieval strategies.", "url": "https://wpnews.pro/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study", "canonical_source": "https://www.machinebrief.com/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-ba-t88z", "published_at": "2026-07-28 04:00:00+00:00", "updated_at": "2026-07-28 04:57:05.590136+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "natural-language-processing"], "entities": ["Qwen3.5-9B", "Qwen3.5-27B"], "alternates": {"html": "https://wpnews.pro/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study", "markdown": "https://wpnews.pro/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study.md", "text": "https://wpnews.pro/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study.txt", "jsonld": "https://wpnews.pro/news/evaluating-rag-for-french-immigration-law-a-benchmark-and-baseline-study.jsonld"}}