{"slug": "hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator", "title": "Hallucination Self-Play: Bootstrapping Reinforced Detector via Evolved Generator", "summary": "Researchers introduced Hallucination Self-Play (HSP), a framework where a detector and generator bootstrap each other to improve hallucination detection in LLMs without external supervision. The detector is fine-tuned on human data and used as a reward model to train the generator via RLAIF, which then produces harder-to-detect hallucinations to further optimize the detector through rule-based reinforcement learning. Experiments on the RAGTruth benchmark showed that small LLMs using HSP can match or outperform advanced LLMs.", "body_md": "arXiv:2607.07993v1 Announce Type: new\nAbstract: Identifying faithfulness hallucinations in LLM-generated outputs remains challenging due to the scarcity of high-quality annotated data. Recent work relies on advanced LLMs to synthesize training data, including rationales, labels, and hallucinated claims. However, these methods treat the generator as a static component, limiting iterative improvement of the detector. To address this limitation, we introduce Hallucination Self-Play (HSP), a novel framework that enables the detector to bootstrap with an evolved generator. HSP involves two roles initialized from the same base model, a detector that assesses the faithfulness of model outputs, and a generator that produces increasingly hard-to-detect hallucinated responses. Specifically, the detector is first fine-tuned on human-labeled data and then employed as a reward model to train the generator via reinforcement learning from AI feedback (RLAIF). In turn, the evolved generator synthesizes hallucination data to further optimize the detector through rule-based reinforcement learning. Experiments on RAGTruth benchmark and two model families demonstrate that the proposed framework can progressively enhance a small LLM to match or even outperform advanced LLMs without external supervision. Our code is available at https://anonymous.4open.science/r/Hallucination-Self-Play-50B5 .", "url": "https://wpnews.pro/news/hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator", "canonical_source": "https://arxiv.org/abs/2607.07993", "published_at": "2026-07-10 04:00:00+00:00", "updated_at": "2026-07-10 04:18:53.555420+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-safety", "generative-ai"], "entities": ["Hallucination Self-Play", "RAGTruth", "arXiv"], "alternates": {"html": "https://wpnews.pro/news/hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator", "markdown": "https://wpnews.pro/news/hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator.md", "text": "https://wpnews.pro/news/hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator.txt", "jsonld": "https://wpnews.pro/news/hallucination-self-play-bootstrapping-reinforced-detector-via-evolved-generator.jsonld"}}