{"slug": "medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail", "title": "MedGuardBench: A Patient-Oriented Benchmark for Personalized Guardrail Development", "summary": "Researchers released MedGuardBench, a drug-disjoint benchmark of 5,001 scenarios across 87 medications for patient-conditioned medication guarding, which predicts a safety verdict and 17 risk categories from a patient profile and prescription. The authors report that standard guardrails rely on surface cues such as wording and profile presence rather than patient facts, and that their personalized reasoning guardrails — combining Personalized Reasoning Distillation, Context Unrolling, and a rule-based reward via guided GRPO — outperform base models and matched no-profile controls in accuracy while reducing false alarms; profile removal and swapping confirm the gains come from patient information, not fine-tuning alone.", "body_md": "arXiv:2611.22069v1 Announce Type: new \nAbstract: Safety is personal: the same action can be safe for one person but unsafe for another. Yet current guardrails judge content without considering who is affected. Using medication safety, we introduce \\textit{patient-conditioned medication guarding}, which predicts a safety verdict and 17 risk categories from a patient profile and prescription. We release \\textbf{MedGuardBench}, a drug-disjoint benchmark of 5{,}001 scenarios across 87 medications. We find that standard guardrails rely on surface cues, such as wording and profile presence, rather than patient facts. To address this, we develop \\textit{personalized reasoning guardrails} with three components. \\textbf{Personalized Reasoning Distillation} links risks to relevant patient fields. \\textbf{Context Unrolling (CU)} makes models check each field themselves, reducing false alarms on most backbones; controls show that providing the check does not yield the same benefit. A \\textbf{rule-based reward (guided GRPO)} improves unsafe recall and complex-risk detection, including allergies and adverse reactions, on some backbones, but increases false alarms on others. Our models outperform base models and matched no-profile controls in accuracy, while reducing false alarms relative to no-profile controls. Profile removal and swapping confirm that gains come from patient information, not fine-tuning alone.", "url": "https://wpnews.pro/news/medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail", "canonical_source": "https://arxiv.org/abs/2611.22069", "published_at": "2026-11-18 05:00:00+00:00", "updated_at": "2026-11-18 05:12:53.724363+00:00", "lang": "en", "topics": ["ai-safety", "ai-research", "large-language-models", "machine-learning"], "entities": ["MedGuardBench", "Personalized Reasoning Distillation", "Context Unrolling", "guided GRPO", "arXiv"], "also_reported_by": [], "takeaway": "Patient-conditioned guardrails trained with Personalized Reasoning Distillation, Context Unrolling and guided GRPO beat base models and no-profile controls on accuracy across 5,001 scenarios and 87 medications, though the rule-based reward raised false alarms on some backbones.", "recommendation": {"advice": "Evaluate guardrails on patient-conditioned, drug-disjoint scenarios rather than generic content, and include no-profile and profile-swap controls to confirm gains come from patient data, not fine-tuning.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail", "markdown": "https://wpnews.pro/news/medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail.md", "text": "https://wpnews.pro/news/medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail.txt", "jsonld": "https://wpnews.pro/news/medguardbench-a-patient-oriented-benchmark-for-personalized-guardrail.jsonld"}}