arXiv:2609.22153v1 Announce Type: new Abstract: Methods for addressing safety drift in fine-tuned Large Language Models (LLMs) are scattered across incompatible implementations, lifecycle stages, and evaluation protocols, making them difficult to adopt and compare. We introduce SafeTune, a source-available library that unifies four intervention paradigms: post-hoc weight recovery, safety-constrained fine-tuning, gradient-based unlearning, and inference-time steering, alongside shared interpretability, evaluation, and deployment utilities. SafeTune provides a consistent configuration-driven workflow while preserving the distinct inputs and intervention points each paradigm requires. Its modular registry supports new methods, benchmarks, judges, models, and fine-tuning domains without redesigning the surrounding pipeline. We demonstrate SafeTune through controlled comparisons and finance and medical deployment case studies, showing how it characterizes safety drift, evaluates feasible interventions on common refusal-behavior and capability evaluations, and supports calibrated or layered mitigation.
SafeTune: A Unified Faithful Library for Auditing and Repairing Safety Drift in Fine-Tuned LLMs
Researchers released SafeTune, a source-available library that unifies four intervention paradigms for auditing and repairing safety drift in fine-tuned large language models: post-hoc weight recovery, safety-constrained fine-tuning, gradient-based unlearning, and inference-time steering. SafeTune, described in arXiv paper 2609.22153v1, adds shared interpretability, evaluation, and deployment utilities plus a modular registry for new methods, benchmarks, judges, models, and fine-tuning domains. The authors demonstrate the library through controlled comparisons and finance and medical deployment case studies evaluating interventions on common refusal-behavior and capability benchmarks.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.