{"slug": "prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language", "title": "PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models", "summary": "A framework called PRISM, introduced in arXiv paper 2610.20808v1, shows that safety interventions estimated from quantized NF4 behavioral labels transfer across languages and model scales, reducing unsafe tool-call violations in Llama-3.1-8B by 21.95 percentage points on held-out Arabic without target-language tuning. The authors report that NF4-supervised directions estimated from very few scenarios transfer to models up to 70B parameters, and they released all experimental code and artifacts at github.com/GiKerche/prism with an interactive explorer of recorded model responses.", "body_md": "arXiv:2610.20808v1 Announce Type: new \nAbstract: Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation interventions across precision, languages, and scales. Our findings demonstrate that leveraging lower-resource settings (specifically quantized NF4 labels and cross-lingual transfer) offers a robust pathway to expose and improve model alignment. Notably, using behavioral labels from an NF4 copy enables stable intervention estimation even with very few scenarios. Furthermore, these alignment improvements transfer effectively across languages: five-language NF4-supervised directions successfully transfer to held-out Arabic, reducing unsafe violations in Llama-3.1-8B by 21.95 percentage points without target-language tuning. By mapping paired benign activations, we also successfully transfer these safety interventions to much larger models (up to 70B parameters). Ultimately, PRISM highlights how auxiliary supervision from compressed models and multilingual data can uncover and mitigate hazardous tool-calling behaviors across different model families. We release all experimental code and supporting artifacts at https://github.com/GiKerche/prism, alongside an interactive explorer of recorded model responses and experimental results at https://gikerche.github.io/prism/.", "url": "https://wpnews.pro/news/prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language", "canonical_source": "https://arxiv.org/abs/2610.20808", "published_at": "2026-10-16 04:00:00+00:00", "updated_at": "2026-10-16 05:07:02.353575+00:00", "lang": "en", "topics": ["ai-safety", "large-language-models", "ai-agents", "ai-research", "natural-language-processing"], "entities": ["PRISM", "Llama-3.1-8B", "arXiv", "GiKerche", "NF4"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language", "markdown": "https://wpnews.pro/news/prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language.md", "text": "https://wpnews.pro/news/prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language.txt", "jsonld": "https://wpnews.pro/news/prism-transfer-and-limits-of-activation-interventions-in-tool-calling-language.jsonld"}}