{"slug": "elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality", "title": "ElevenLabs releases Dubbing v2 model to enhance AI voice translation quality", "summary": "ElevenLabs released Dubbing v2, a new AI dubbing model that conditions directly on original audio performances rather than text transcripts, preserving tone, pacing, and emotion across more than 90 languages. The model handles up to 32 speakers per audio file, includes sync-aware translation that automatically aligns speech timing with the original audio, and retains background audio untouched. ElevenLabs is distributing Dubbing v2 through ElevenCreative for individual creators and ElevenProductions for enterprise clients, with an API that rolled out on August 6, 2026, and a Creator Dubbing Partner Program offering up to 30 minutes of free usage during a seven-day promotional period.", "body_md": "# ElevenLabs releases Dubbing v2 model to enhance AI voice translation quality\n\nThe new model conditions directly on original audio performances, preserving tone, pacing, and emotion across more than 90 languages.\n\nElevenLabs just shipped what might be the most significant upgrade to AI-powered dubbing since the technology left the research lab. Dubbing v2, the company’s latest model, takes a fundamentally different approach to voice translation: instead of working from text transcripts like its predecessor, it listens to the original audio performance and conditions its output directly on what it hears.\n\nThe practical result is translated audio that actually sounds like the original speaker said those words in another language. Tone, pacing, emotional delivery, all preserved.\n\n## How Dubbing v2 works differently\n\nTraditional AI dubbing pipelines follow a predictable sequence: transcribe the audio to text, translate the text, then synthesize new speech from the translated script. Dubbing v2 skips the middleman. By conditioning directly on the source audio, the model captures vocal characteristics that a text transcript simply cannot encode.\n\nThe model supports more than 90 languages with regional variants. It can detect and handle up to 32 speakers per audio file, making it viable for everything from solo podcast episodes to ensemble-cast productions with overlapping dialogue.\n\nOne of the more quietly impressive features is sync-aware translation. The system automatically synchronizes speech timing with the original audio, which eliminates the painstaking lip-sync adjustments that have historically made professional dubbing so expensive and slow. It also retains original background audio, meaning ambient sound, music, and sound effects pass through untouched while only the vocal track gets translated.\n\n## Where it’s available and what it costs\n\nElevenLabs is distributing Dubbing v2 through two platforms. ElevenCreative targets individual creators, YouTubers, podcasters, and independent filmmakers who want to reach multilingual audiences without hiring a dubbing studio. ElevenProductions serves enterprise clients with larger-scale localization needs.\n\nTo encourage adoption, ElevenLabs launched a Creator Dubbing Partner Program alongside the model. The program offers limited free usage of up to 30 minutes during an initial seven-day promotional period.\n\nFor developers and larger organizations wanting to build dubbing directly into their own products, an API rolled out on August 6, 2026. Meanwhile, the original Dubbing v1 remains available for cost-sensitive projects where absolute fidelity to the source performance matters less than getting content translated at scale on a tight budget.\n\n**Disclosure:** This article was edited by Editorial Team. For more information on how we create and review content, see our\n\n[Editorial Policy](https://cryptobriefing.com/editorial-policy/).", "url": "https://wpnews.pro/news/elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality", "canonical_source": "https://cryptobriefing.com/elevenlabs-dubbing-v2-model-release/", "published_at": "2026-09-10 14:50:50+00:00", "updated_at": "2026-09-10 15:18:20.469748+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-products", "generative-ai", "natural-language-processing", "ai-tools"], "entities": ["ElevenLabs", "Dubbing v2", "ElevenCreative", "ElevenProductions", "Creator Dubbing Partner Program", "Dubbing v1"], "alternates": {"html": "https://wpnews.pro/news/elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality", "markdown": "https://wpnews.pro/news/elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality.md", "text": "https://wpnews.pro/news/elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality.txt", "jsonld": "https://wpnews.pro/news/elevenlabs-releases-dubbing-v2-model-to-enhance-ai-voice-translation-quality.jsonld"}}