{"slug": "higgs-audio-v3-tts-4b-built-for-voice-chat", "title": "Higgs Audio v3 TTS 4B: Built for voice chat", "summary": "Boson AI released Higgs Audio v3 TTS, a text-to-speech model designed for voice chat that generates expressive conversational speech across 100+ languages with zero-shot voice cloning and inline control over emotion, style, and prosody. The model achieves single-digit word error rates on multilingual benchmarks and outperforms competing systems including Fish Audio S2 Pro and Qwen3-TTS-1.7B in conversational behavior evaluations. The release addresses the need for TTS systems that can produce real-time, expressive speech for voice AI agents rather than simply reading text aloud.", "body_md": "[More articles](/blog)\n\n# Higgs Audio v3 TTS: Beyond Reading, Toward Real Speech for Voice AI\n\nHiggs Audio v3 TTS is built for voice chat: it speaks, not just reads. It turns model responses into expressive conversational speech across 100+ languages, with zero-shot voice cloning and inline control over emotion, style, prosody, pauses, and sound effects.\n\nVoice AI needs a different kind of text-to-speech. In a live conversation, speech is not just the last step after text generation. It is how the agent answers, reacts, pauses, emphasizes, and carries the turn.\n\nHiggs Audio v3 TTS is built for that setting: beyond reading, toward real speech for voice AI. It keeps the reliability of a production TTS system, but it is designed to speak model responses in the moment, with the timing and expression that make an agent feel conversational.\n\nThe model is directly controllable from the text stream. Inline tags can change emotion, style, speed, pitch, pauses, and sound effects mid-utterance, so developers can shape how a response is spoken without leaving the generation flow.\n\nOut of the box, Higgs Audio v3 TTS reaches single-digit WER/CER on 100+ languages. Across\n\n[Seed-TTS](https://github.com/BytedanceSpeech/seed-tts-eval),[CV3](https://github.com/FunAudioLLM/CV3-Eval),[MiniMax-Multilingual](https://arxiv.org/abs/2505.07916), and Higgs-Multilingual, v3 sets the lowest WER against[Higgs Audio v2](https://huggingface.co/bosonai/higgs-audio-v2-generation-3B-base)and a broad comparison set of open and commercial systems.#### Multilingual Benchmarks\n\nWe evaluate Higgs Audio v3 TTS on public multilingual TTS suites and our internal 111-language Higgs-Multilingual set, covering both common and lower-resource languages.\n\nThe table reports macro-averaged WER/CER (↓, x100). Lower is better; highlighted cells mark the best result per row. Non-Higgs bests are selected from\n\n[Fish Audio S2 Pro](https://huggingface.co/fishaudio/s2-pro),[Qwen3-TTS-1.7B](https://huggingface.co/Qwen/Qwen3-TTS-12Hz-1.7B-Base),[VibeVoice-7B](https://huggingface.co/vibevoice/VibeVoice-7B),[IndexTTS-2](https://huggingface.co/IndexTeam/IndexTTS-2),[MiMo-Audio-7B-Instruct](https://huggingface.co/XiaomiMiMo/MiMo-Audio-7B-Instruct),[MOSS-TTS-v1.5](https://huggingface.co/OpenMOSS-Team/MOSS-TTS-v1.5),[OmniVoice](https://huggingface.co/k2-fsa/OmniVoice),[ChatterBox](https://huggingface.co/ResembleAI/chatterbox), and[FireRedTTS-2](https://huggingface.co/FireRedTeam/FireRedTTS2).| Benchmark | # langs | Higgs Audio v2 | Higgs Audio v3 | Non-Higgs Best Model |\n|---|---|---|---|---|\n|\n\n[CV3](https://github.com/FunAudioLLM/CV3-Eval)[MiniMax-Multilingual](https://arxiv.org/abs/2505.07916)Higgs Audio v3's results have been reproduced by\n\n[SGLang-Omni team.](https://www.lmsys.org/blog/2026-06-04-higgs-audio-v3-tts/)#### Conversational Behavior Benchmarks\n\n[Emergent TTS](https://github.com/boson-ai/EmergentTTS-Eval-public)evaluates conversational behaviors that are hard to capture with transcript accuracy alone, including emotion, foreign words, paralinguistic cues, complex pronunciation, questions, and syntactic complexity.\n\nWin-rate (↑) per category, measured as judge preference versus the baseline row. For a fair comparison, every model shares the same reference audio per prompt, and we run the benchmark text verbatim with no inline control tags inserted.\n\n| Category | Higgs Audio v3 | Fish Audio S2 Pro | Qwen3-TTS-1.7B | IndexTTS-2 | MOSS-TTS-v1.5 | OmniVoice |\n|---|---|---|---|---|---|---|\n| Overall ↑ | 53.65% | 43.80% | 38.84% | 31.12% | 43.89% | 40.82% |\n| Emotions ↑ | 53.75% | 53.04% | 45.54% | 39.29% | 60.54% | 61.07% |\n| Foreign Words ↑ | 48.75% | 33.93% | 24.64% | 5.36% | 35.18% | 28.75% |\n| Paraling- uistics ↑ | 68.57% | 53.75% | 44.29% | 42.50% | 51.43% | 52.68% |\n| Complex Pronunciation ↑ | 25.10% | 18.16% | 30.00% | 12.45% | 11.63% | 13.67% |\n| Questions ↑ | 61.43% | 55.00% | 53.39% | 45.89% | 53.21% | 45.00% |\n| Syntactic Complexity ↑ | 60.71% | 45.71% | 34.11% | 38.93% | 47.32% | 40.36% |\n\n#### Try It\n\nThe fastest way to hear Higgs Audio v3 TTS is in\n\n[Boson Workspace](/workspace/avatar). Choose a voice, enter a response, and experiment with emotion, prosody, pauses, and style tags directly in the browser.We’re currently stabilizing the playground. Thanks for your patience.\n\nWhen you are ready to build, use the\n\n[Boson API](https://docs.boson.ai/models/higgs-audio-tts/overview). The endpoint supports blocking and streaming generation, voice cloning from audio references, and the same inline controls used in the workspace.For local inference, the model weights are available on\n\n[Hugging Face](https://huggingface.co/bosonai/higgs-audio-v3-tts-4b). You can serve them with[SGLang-Omni](https://sgl-project.github.io/sglang-omni/cookbook/higgs_tts.html)using the Higgs TTS cookbook.##### Acknowledgments\n\nContributors: Silin Meng, Ke Bai, Ruskin Raj Manku, Huapeng Zhou, Jonah Mackey, Dongming Shen, Erik Li, Weisu Yin, Yizhi Liu, Xinyu Wang, Alex Chen, Jaewon Lee, Lindsey Allen, Mu Li\n\nSpecial thanks to the broader Boson team for supporting training and evaluation, SGLang-Omni team for optimizing inference, and MKTech for development support.", "url": "https://wpnews.pro/news/higgs-audio-v3-tts-4b-built-for-voice-chat", "canonical_source": "https://www.boson.ai/blog/higgs-audio-v3-tts", "published_at": "2026-06-05 03:38:11+00:00", "updated_at": "2026-06-05 03:46:15.994195+00:00", "lang": "en", "topics": ["artificial-intelligence", "generative-ai", "ai-products", "ai-tools", "natural-language-processing"], "entities": ["Higgs Audio", "Seed-TTS", "CV3", "MiniMax-Multilingual", "Higgs-Multilingual", "BytedanceSpeech", "FunAudioLLM", "bosonai"], "alternates": {"html": "https://wpnews.pro/news/higgs-audio-v3-tts-4b-built-for-voice-chat", "markdown": "https://wpnews.pro/news/higgs-audio-v3-tts-4b-built-for-voice-chat.md", "text": "https://wpnews.pro/news/higgs-audio-v3-tts-4b-built-for-voice-chat.txt", "jsonld": "https://wpnews.pro/news/higgs-audio-v3-tts-4b-built-for-voice-chat.jsonld"}}