cd /news/artificial-intelligence/diarization-guided-qwen-asr-adaptati… · home topics artificial-intelligence article
[ARTICLE · art-53680] src=machinebrief.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech

Researchers developed a modular speaker diarization front end combined with an adapted Qwen3-ASR-1.7B recognizer for multilingual two-speaker conversational speech, achieving a tcpMER of 17.97 on the final evaluation set of the MLC-SLM 2026 Challenge. The system uses supervised fine-tuning, LoRA adaptation with synthetic speech, and GRPO reinforcement learning to reduce error rates by 6.83 absolute points over the baseline.

read1 min views1 publishedJul 10, 2026

arXiv:2607.08208v1 Announce Type: new Abstract: This paper describes our self-designed system for Task 1 of the MLC-SLM 2026 Challenge for multilingual two-speaker conversational speech. The system combines a modular speaker diarization front end with a challenge-adapted Qwen3-ASR-1.7B recognizer. The diarization front end performs voice activity detection, subsegment generation, CAMPPlus speaker embedding extraction, two-speaker spectral clustering, and RTTM-based audio segmentation. The resulting speaker-attributed segments are grouped by language or region and decoded by the adapted ASR model. For ASR adaptation, we first perform supervised full fine-tuning on the official training data, then apply LoRA fine-tuning with synthetic speech generated by a three-pipeline TTS-based synthetic speech augmentation framework, and finally refine the model using GRPO reinforcement learning with rewards based on WER/CER and penalties for hallucination, repetition, and length deviation. On the official development set, the full system achieves an average tcpMER of 23.70, reducing the error rate by 6.83 absolute points relative to the released Qwen-ASR-1.7B performance. On the final evaluation set, the system achieves an average tcpMER of 17.97. Ablation results show that supervised fine-tuning provides the largest gain, while synthetic-speech LoRA adaptation and reinforcement learning further improve robustness.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @qwen3-asr-1.7b 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/diarization-guided-q…] indexed:0 read:1min 2026-07-10 ·