cd /news/natural-language-processing/rationale-guided-knowledge-distillat… · home topics natural-language-processing article
[ARTICLE · art-68015] src=arxiv.org ↗ pub= topic=natural-language-processing verified=true sentiment=· neutral

Rationale-Guided Knowledge Distillation for Cross-Lingual Stance Detection

A rationale-guided knowledge distillation framework for cross-lingual stance detection outperforms competitive baselines on multilingual benchmarks, according to a new arXiv preprint (2607.18693v1). The method uses Chain-of-Thought prompting to generate rationales from Large Language Models and distills reasoning knowledge into a compact student model via a dual-path distillation mechanism and contrastive learning strategies, addressing the lack of annotated data in low-resource languages like Catalan.

read1 min views1 publishedJul 22, 2026

arXiv:2607.18693v1 Announce Type: new Abstract: Stance detection aims to identify whether a text expresses a favorable or opposing attitude toward a given target, and serves as an important task for various downstream applications. Although existing studies have achieved strong performance in monolingual settings, especially in English, many low-resource languages such as Catalan still lack sufficient annotated data for training effective models. Cross-lingual stance detection alleviates this problem by transferring stance knowledge from resource-rich languages to low-resource languages. However, most existing methods mainly rely on semantic alignment between texts and targets, while ignoring the reasoning process required for reliable stance inference. Although Large Language Models provide strong reasoning ability, their high computational cost and inference latency limit practical deployment. To address these limitations, we propose a rationale-guided knowledge distillation framework for cross-lingual stance detection. Specifically, we use Chain-of-Thought prompting to guide Large Language Models in generating informative rationales, and distill the resulting reasoning knowledge into a compact student model. We further design a dual-path distillation mechanism to align rationale-enhanced and rationale-free representations, together with their prediction distributions. In addition, two contrastive learning strategies are introduced to improve stance discrimination. Experiments on multilingual benchmarks demonstrate that our method consistently outperforms competitive baselines.

── more in #natural-language-processing 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/rationale-guided-kno…] indexed:0 read:1min 2026-07-22 ·