{"slug": "scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models", "title": "Scaling Therapy Supervision: Assessing Psychotherapy Fidelity Using Large Language Models", "summary": "A new arXiv paper (2610.28772v1) reports that a large language model pipeline can automate psychotherapy fidelity assessment, the manual expert-review process that measures how closely a therapist follows a treatment protocol. The authors evaluated three open-weight models across multiple task-decomposition configurations and reasoning strategies, finding that evidence-first reasoning improves fidelity estimation, and validated the framework on an independent randomized controlled trial where it reliably distinguished Cognitive Behavioral Therapy from non-CBT sessions across core therapeutic skills. In a user study, mental health experts judged the generated feedback actionable, which the authors present as a scalable route to closing the community mental health supervision gap.", "body_md": "arXiv:2610.28772v1 Announce Type: new \nAbstract: Psychotherapy fidelity assessment measures how faithfully a therapist adheres to a treatment protocol, a critical determinant of positive patient outcomes. However, fidelity assessment is bottlenecked by manual expert review, rendering the process labor-intensive and unscalable. To scale therapy supervision and support clinician self-learning, we present an integrated application of large language models (LLMs) that automates psychotherapy fidelity workflows and generates actionable supervisory feedback from authentic, long-form clinical transcripts. We evaluate three open-weight models across multiple task decomposition configurations and reasoning strategies, demonstrating that evidence-first reasoning improves fidelity estimation. Furthermore, we establish the framework's external construct validity on an independent randomized controlled trial (RCT), where it reliably distinguishes Cognitive Behavioral Therapy (CBT) from non-CBT sessions across core therapeutic skills. Through a user study that evaluates the generated feedback, mental health experts indicate that the pipeline synthesizes actionable clinical feedback. Ultimately, our work offers a practical, scalable solution toward bridging the community mental health supervision gap.", "url": "https://wpnews.pro/news/scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models", "canonical_source": "https://arxiv.org/abs/2610.28772", "published_at": "2026-10-22 04:00:00+00:00", "updated_at": "2026-10-22 04:11:56.706672+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-safety"], "entities": ["arXiv", "Cognitive Behavioral Therapy"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models", "markdown": "https://wpnews.pro/news/scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models.md", "text": "https://wpnews.pro/news/scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models.txt", "jsonld": "https://wpnews.pro/news/scaling-therapy-supervision-assessing-psychotherapy-fidelity-using-large-models.jsonld"}}