cd /news/artificial-intelligence/dualanchor-preserving-language-prior… · home topics artificial-intelligence article
[ARTICLE · art-81341] src=machinebrief.com ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

DualAnchor: Preserving Language Priors and Improving Lexical Fidelity in Gloss-Free Sign Language Translation

Researchers propose DualAnchor, a gloss-free sign language translation framework that preserves language priors and improves lexical fidelity, achieving strong performance on PHOENIX-2014T and CSL-Daily. The framework uses Token-level Prior Anchoring (TPA) to regularize the multimodal decoder toward a frozen LLM's next-token distribution, and Optimal Transport Alignment (OTA) to align visual and textual tokens via Sinkhorn optimization. The study attributes fluency gains to TPA and reduced lexical errors to OTA.

read1 min views1 publishedJul 31, 2026

arXiv:2607.27614v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have led sign language translation (SLT), the task of converting sign-language videos into spoken-language text, to increasingly adopt LLMs as textual backbones. However, despite their strong language modeling capabilities, existing LLM-based SLT methods often undermine rather than exploit this language prior, producing disfluent translations, a failure we term language-prior degradation. Meanwhile, existing methods typically align videos and text at the sentence level, which does not ensure accurate lexical details and creates a lexical fidelity gap. To address both issues, we propose DualAnchor, a gloss-free LLM-based SLT training framework that couples two complementary anchors for linguistically fluent and visually faithful generation. Token-level Prior Anchoring (TPA) preserves the LLM's language prior by regularizing the multimodal decoder at each decoding step toward the next-token distribution of a frozen LLM conditioned on the same autoregressive prefix. Optimal Transport Alignment (OTA) improves lexical fidelity by formulating visual-textual matching as entropy-regularized partial optimal transport, with Sinkhorn optimization inducing a soft alignment between visual tokens and textual content tokens under a cosine cost. DualAnchor achieves strong overall performance on both PHOENIX-2014T and CSL-Daily. Targeted analyses attribute these gains to the complementary effects of the two anchors: TPA improves fluency, whereas OTA reduces fine-grained lexical errors.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @dualanchor 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/dualanchor-preservin…] indexed:0 read:1min 2026-07-31 ·