{"slug": "tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open", "title": "TTS & STT Landscape in Spring–Summer 2026: On-Device Breakthroughs, API Consolidation, and Open-Source Acceleration", "summary": "On-device text-to-speech engines are approaching cloud quality in spring–summer 2026, led by Supertonic's 99M-parameter model running 167× real-time across 31 languages, while cloud APIs consolidate the STT→LLM→TTS pipeline into single calls and open-source models add emotion control and zero-shot voice cloning. OfflineTTS reports that Supertonic 3, integrated on May 13, supports 5 languages initially with 10 preset voices and a quality-speed trade-off controlled by Steps and Speed knobs, and Kokoro TTS ranks 32nd overall but #1 among browser-runnable models in the TTS Arena.", "body_md": "[← Back to Blog](/blog/)\n\n# TTS & STT Landscape in Spring–Summer 2026: On-Device Breakthroughs, API Consolidation, and Open-Source Acceleration\n\n- tts\n- stt\n- offline\n- open-source\n- supertonic\n- kokoro\n- grok\n- gemini\n- realtime-api\n- on-device\n- whisper\n- voice-cloning\n- browser\n- arena\n\nIf 2025 was the year TTS became “usable,” the first half of 2026 is when it hit an inflection point. On-device engines are approaching cloud quality faster than most predicted. Cloud APIs are collapsing the three-stage STT→LLM→TTS pipeline into a single call. Open-source models are covering capabilities — emotion control, multi-speaker dialogue, zero-shot voice cloning — that were exclusive to commercial APIs just months ago. And all of this is happening simultaneously.\n\nHere is the TTS/STT landscape as of mid-2026, based on offlinetts.com’s blog coverage.\n\n## 1. On-Device TTS: Two Flagship Releases and a Steady Workhorse\n\n### 1.1 Supertonic — 99M Parameters, 31 Languages, 167× Real-Time\n\nSupertonic (by Supertone Inc.) is the most technically impressive on-device TTS release of the season. It runs on ONNX Runtime for fully local inference.\n\n| Dimension | Spec |\n|---|---|\n| Model size | ~99 million parameters (99M) |\n| Inference speed | 167× real-time — 1 hour of audio in ~22 seconds |\n| Languages | 31 |\n| Run targets | Raspberry Pi, phone, browser (WebGPU / WASM) |\n| Latest version | Supertonic 3: improved accuracy and language coverage |\n| Custom voices | Voice Builder tool from short reference clips |\n\nOfflineTTS integrated Supertonic on May 13, initially supporting 5 languages (English, Spanish, Portuguese, French, Korean) with 10 preset voice styles. Two core knobs control the quality/speed trade-off — **Steps** (denoising passes) and **Speed** (speech rate):\n\n| Steps | Best For | Trade-off |\n|---|---|---|\n| 4–8 | Quick drafts and previews | Fastest, less refined |\n| 8 (default) | Everyday use | Balanced quality and latency |\n| 12–20 | Final exports | Smoother but slower |\n\nModel assets are cached in IndexedDB after first load, so repeat visits skip re-downloads.\n\n**Bottom line:** For any use case where privacy, latency, or offline operation is a requirement, Supertonic has become the benchmark that other on-device solutions are measured against.\n\n### 1.2 ToBe SAID — Fully Offline Android TTS Engine\n\nUnlike Supertonic’s developer focus, ToBe SAID delivers a polished end-user experience as a system-level Android TTS engine. It runs entirely on-device and is built around ebook-to-audiobook conversion. Recent updates significantly improved voice stability and naturalness. The free tier covers one voice slot; Pro unlocks unlimited slots.\n\n### 1.3 Kokoro TTS — The On-Device Workhorse\n\nKokoro is built on StyleTTS 2 architecture — 82M parameters, 82MB ONNX model, and the most mature ecosystem among browser-runnable TTS engines:\n\n**88 voices**, graded A–D by quality** 9 languages**: English (US/UK), Japanese, Chinese, French, Spanish, Hindi, Italian, Portuguese, Korean** Run modes**: browser (WebGPU / WASM), Python CLI, API ($0.65/1M chars)** License**: Apache 2.0\n\n**Top English A-grade voices:**\n\n| Voice | Accent | Best For |\n|---|---|---|\n| Heart | American | Audiobook narration, YouTube voiceovers |\n| Bella | American | Conversational content, podcasts |\n| Nova | American | Professional presentations, e-learning |\n| Nicole | British | British narration, formal content |\n\n**TTS Arena performance:**\n\nKokoro ranks **32nd overall** (Elo 1056) out of 74 models — but it is **#1 among browser-runnable models**. It excels at knowledge-sharing content (articles, docs, education) with Elo 1066, outperforming Google WaveNet (873) and Amazon Polly Neural (868).\n\n| Category | Accent | Elo | Win Rate |\n|---|---|---|---|\n| Knowledge sharing | All | 1065.8 | 57.1% |\n| Assistants | All | 1065.8 | 50.9% |\n| Customer service | US | 1135.4 | 46.0% |\n\nFor anyone who wants TTS without cloud APIs or GPU servers, Kokoro is the most pragmatic choice available.\n\n## 2. Cloud APIs: Consolidation, Speed, Emotion\n\n### xAI Grok TTS & STT — A New Contender\n\nxAI entered the voice API market in May with Grok TTS and STT, emphasizing speed, multilingual accuracy, and easy integration (already available through Telnyx for telephony apps). The message is clear: major AI platform companies now treat voice I/O as a core capability, not an add-on.\n\n### OpenAI Realtime API — Single-Call Architecture\n\nThis is the most architecturally significant shift this year. The traditional voice agent pipeline:\n\n```\nSTT (speech→text) → LLM (reasoning+generation) → TTS (text→speech)\n```\n\nEach hop adds latency and integration overhead. The Realtime API compresses this into **one call: speech in, speech out**.\n\n| Dimension | Traditional Pipeline | OpenAI Realtime API |\n|---|---|---|\n| API calls | 3+ | 1 |\n| Latency | Cumulative per hop | End-to-end optimized |\n| Orchestration | High (WebSocket management) | Low |\n| Best fit | When cloud is acceptable | Privacy-sensitive still needs on-device |\n\n### Gemini 3.1 Flash TTS — Emotional Control at Scale\n\nGoogle’s Gemini 3.1 Flash TTS brings two breakthroughs:\n\n**70+ languages**— one of the broadest cloud TTS coverages available** Fine-grained emotional control**— adjusts tone, emphasis, and affect to match content context\n\nThis upgrades TTS from “listenable” to “engaging.” In the Artificial Analysis TTS Arena it ranks **#2 with 1205.8 Elo**, just 4 points behind Inworld Realtime TTS 1.5 Max (1209.6).\n\n### Other Commercial API Notes\n\n**ElevenLabs v3**: Quality benchmark (1178 Elo), but $100/1M chars — most expensive** MiniMax Speech 2.8 HD / Turbo**: Solid top-10 performers (1163.7 / 1146.7 Elo)** Azure Speech Service**: Expanding language coverage, enterprise SLAs\n\n## 3. TTS Arena Leaderboard Deep Dive\n\nThe Artificial Analysis Speech Arena ranks **74 models** by Elo through blind A/B listening tests — the most objective TTS quality benchmark available.\n\n### Top 10 (All Closed-Source Commercial)\n\n| Rank | Model | Creator | Elo | Win Rate | Price/1M chars |\n|---|---|---|---|---|---|\n| 1 | Realtime TTS 1.5 Max | Inworld | 1209.6 | 73.3% | $35 |\n| 2 | Gemini 3.1 Flash TTS | 1205.8 | 72.4% | $36.61 | |\n| 3 | Eleven v3 | ElevenLabs | 1178.0 | 68.9% | $100 |\n| 4 | Inworld TTS 1 Max | Inworld | 1165.4 | 66.1% | $35 |\n| 5 | Speech 2.8 HD | MiniMax | 1163.7 | 65.2% | $100 |\n| 6 | Realtime TTS 1.5 Mini | Inworld | 1158.4 | 66.2% | $25 |\n| 7 | Step TTS 2 | StepFun | 1149.1 | 64.6% | $40 |\n| 8 | Speech 2.8 Turbo | MiniMax | 1146.7 | 64.0% | $60 |\n| 9 | Speech 2.6 HD | MiniMax | 1133.5 | 62.1% | $100 |\n| 10 | Speech 2.6 Turbo | MiniMax | 1128.7 | 61.3% | $60 |\n\n### Open-Weight Model Standings\n\n| Overall Rank | Model | Creator | Elo | Win Rate | Notes |\n|---|---|---|---|---|---|\n| 11 | Fish Audio S2 Pro | Fish Audio | 1128.7 | 61.0% | Best open-weight; needs GPU |\n| 32 | Kokoro 82M v1.0 | Kokoro | 1056.2 | 54.4% | Browser-runnable, 82MB |\n| 33 | Voxtral TTS | Mistral | 1055.9 | 52.3% | Released March 2026 |\n| 35 | Maya1 | Maya Research | 1050.6 | 50.5% | |\n| 51 | Fish Speech 1.5 | Fish Audio | 1011.9 | 49.1% | |\n| 52 | Chatterbox | Resemble AI | 1006.4 | 47.9% | |\n| 55 | Zonos v0.1 | Zyphra | 1000.0 | 47.1% | |\n| 60 | OpenVoice v2 | OpenVoice | 949.9 | 44.0% | |\n| 66 | XTTS v2 | Coqui | 885.9 | 36.4% | |\n| 67 | StyleTTS 2 | StyleTTS | 878.8 | 37.4% | |\n| 74 | MetaVoice v1 | MetaVoice | 765.2 | 21.5% |\n\n### The Gap Is Shrinking — Fast\n\n| Era | Best Open-Weight Elo | Best Commercial Elo | Gap |\n|---|---|---|---|\n| 2023 | 879 (StyleTTS 2) | 1102 (OpenAI TTS-1) | 223 |\n| 2024 | 950 (OpenVoice v2) | 1107 (ElevenLabs v2) | 157 |\n| Early 2025 | 1006 (Chatterbox) | 1134 (MiniMax Speech 2.6 HD) | 128 |\n| Mid 2025 | 1056 (Kokoro) | 1170 (Eleven v3 pre) | 114 |\nEarly 2026 | 1129 (Fish Audio S2 Pro) | 1210 (Inworld RT 1.5 Max) | 81 |\n\nFrom 223 to 81 — a **64% reduction** in under 3 years. At the current trajectory, an open-weight model could crack the top 10 within a year.\n\n⚠️\n\nCaveat:Elo measures listener preference, not objective quality. It does not capture latency, privacy, cost at scale, language coverage, or browser-deployability — factors that matter enormously in production.\n\n## 4. Open-Source Model Ecosystem: MOSS-TTS and Beyond\n\n### MOSS-TTS Family (OpenMOSS / MOSI.AI)\n\nThe most ambitious open-source speech generation effort today — not a single model but a family:\n\n| Variant | Core Capabilities |\n|---|---|\nMOSS-TTS | High-fidelity long-form speech, multi-speaker dialogue, real-time streaming TTS, sound design |\nMOSS-TTS-Nano | Lightweight variant for mobile and embedded devices |\n\nKey capabilities:\n\n**Long-form fidelity**— sustained quality across extended passages, solving the “starts good, degrades after a few sentences” problem** Multi-speaker dialogue**— distinct voices within a single generation, no stitching needed** Real-time streaming**— chunk-by-chunk output with minimal buffering** Sound effects**— non-speech audio generation for games and media production\n\nAlso active: Chatterbox, Fish Audio S2 Pro, Kokoro, and Zonos all continue to receive community updates.\n\n## 5. Browser-Based STT: The Technical Landscape\n\nBrowser-based speech recognition has moved from demo-grade to production-ready in 2026.\n\n### How It Works\n\nThree stages:\n\n**Audio capture & decoding**— microphone or file → mono 16kHz PCM (Whisper’s expected format), WebCodecs for hardware acceleration** Neural inference**— Whisper encoder-decoder via ONNX Runtime Web, WebGPU preferred, WASM fallback** Post-processing**— raw tokens → text, timestamp tokens → segment boundaries, long audio via 30s sliding windows\n\n### Model Family Comparison\n\n| Library | Models | Languages | Model Size | WebGPU | Streaming | Worker-Based |\n|---|---|---|---|---|---|---|\ntransformers.js | tiny/base/small/large | 99 | 40–3000 MB | ✅ | ❌ | ❌ |\nbrowser-whisper | tiny/base/small | 99 | 40–240 MB | ✅ | ✅ | ✅ |\nWhisper.cpp | tiny~large-v3 | 99 | 39–3000 MB | ❌ | ❌ | Native |\nMoonshine | tiny/base | English only | 6–61 MB | ✅ | ❌ | ❌ |\nDistil-Whisper | small/medium | English only | 185–760 MB | ✅ | ❌ | ❌ |\n\n### Model Size vs. Accuracy\n\n| Model | Parameters | Download (hybrid quant) | Relative Accuracy | WebGPU RT Factor |\n|---|---|---|---|---|\n| Whisper Tiny | 39M | ~40 MB | Adequate for clear speech | 10–15× |\nWhisper Base | 74M | ~76 MB | Best balance for most use cases | 5–8× |\n| Whisper Small | 244M | ~240 MB | Handles accents/noise best | 2–4× |\n\n### Why Quantization Matters More Than You Think\n\nONNX models can be quantized to reduce size, but **not all parts should be quantized equally**:\n\n**Encoder (feature extractor)**: Quantization-sensitive —** fp32 recommended**. Quantizing to q8 degrades feature quality, producing garbled output on accented or noisy audio.** Decoder (text generator)**: Quantization-tolerant — q4 or q8 both work; q4 is significantly smaller.\n\nThis is why **browser-whisper defaults to hybrid quantization (fp32 encoder + q4 decoder)**. A full q8 model at ~300 MB is not just larger — it can produce *worse* transcriptions than the 76 MB hybrid version, because encoder quantization noise propagates through the entire decoder stack.\n\n### WebGPU vs WebAssembly\n\nWebGPU provides 5–10× speedup over WASM for Whisper, but browser support is uneven:\n\n| Browser | WebGPU Support |\n|---|---|\n| Chrome 113+ / Edge 113+ | ✅ Best performance |\n| Safari 17.4+ | ✅ macOS and iOS |\n| Firefox | ❌ Behind a flag |\n| Linux Chrome | ⚠️ Needs `--enable-unsafe-webgpu` |\n\nA robust production implementation **must fall back to WASM gracefully**.\n\n### Two Common Issues with Long Audio\n\n-\n**Hallucination**: Whisper can generate repetitive nonsense text at chunk boundaries or in silent regions. In transformers.js v3.8.1,`SuppressTokensLogitsProcessor`\n\nis commented out, leaving 90 hallucination-prone tokens unsuppressed. browser-whisper applies correct pipeline configuration to mitigate this. -\n**Timestamp drift**: At chunk boundaries, timestamps can drift or overlap, requiring post-processing for subtitle formats (SRT/VTT).\n\n### Production Architecture Recommendations\n\n**Most use cases**: browser-whisper + whisper-base + hybrid quantization** Maximum accuracy**: browser-whisper + whisper-small** Slow connections / fastest first load**: whisper-tiny** Real-time streaming (live captions)**: Moonshine** Server-side deployment**: Whisper.cpp\n\n## 6. Voice Cloning: Three Engines Compared\n\nVoice cloning is now fully achievable offline. OfflineTTS compared three leading engines in detail.\n\n### At a Glance\n\n| Dimension | KokoClone | Kitten Fine-Tune | Piper Express Clone |\n|---|---|---|---|\nMethod | Zero-shot (speaker encoder) | Full fine-tuning | Synthetic data + fine-tune |\nReference audio | 3–10 seconds | 5–30 min (transcribed) | 3–10 seconds |\nTraining needed? | ❌ No | ✅ 6–12 hours | ✅ 2–4 hours |\nGPU needed? | ❌ CPU works | ✅ 8–40GB VRAM | ✅ Recommended 8–12GB VRAM |\nClone quality | Good | Good (with enough data) | Best |\nInference speed | ~150ms/10s text (CPU) | Very fast (tiny model) | Real-time on CPU |\nModel size | ~84MB | 20–30MB | ~75MB |\nMulti-language | ✅ 9 languages | ❌ Single | ✅ |\n\n### Detailed Breakdown\n\n#### KokoClone — Zero-Shot Instant Cloning\n\nKokoClone uses an ECAPA-TDNN speaker encoder to extract acoustic features from a short audio sample, producing a speaker embedding that plugs directly into Kokoro’s existing decoder. No retraining needed.\n\n``` python\nfrom kokoclone import KokoClone\n\nclone = KokoClone(device=\"cpu\")\naudio = clone.text_to_speech(\n    text=\"Hello, this is my cloned voice.\",\n    ref_wav=\"my_voice.wav\",\n    language=\"en\"\n)\n```\n\n**Best for:** Rapid prototyping, personal assistants, IoT devices. Clone quality depends heavily on reference audio quality.\n\n#### Kitten TTS — Fine-Tuning for Tiny Footprints\n\nKitten is a lightweight VITS architecture (15M params, 15–80MB). No zero-shot mechanism — you need 5–30 minutes of transcribed audio and 6–12 hours of GPU training. The output is a 20–30MB model that runs extremely fast on CPU.\n\n**Best for:** Embedded systems, mobile apps, Raspberry Pi Zero — where size and speed matter more than setup convenience.\n\n#### Piper Training Suite — Express Clone\n\nTwo-stage pipeline:\n\n**Chatterbox** generates 1,500+ synthetic training clips from 3–10 seconds of reference audio**Piper fine-tuning** runs 300–500 epochs, exports a standard ONNX model\n\n```\n# One-command clone\npython cloneToPiper.py MyVoice ./reference.wav \\\n    --samples 200 --epochs 500 --quality high --language en-us\n\n# Use the cloned voice\npiper -m ./exports/MyVoice.onnx -t \"This is my cloned voice\"\n```\n\nHighest quality among the three, but requires 2–4 hours of training.\n\n**Best for:** Audiobook production, customer service voice bots, game character voiceovers.\n\n### Decision Framework\n\n**Need the voice now?**→ KokoClone (seconds, no GPU)** Highest possible quality?**→ Piper Express Clone (fine-tuning > zero-shot)** CPU only?**→ KokoClone (only option)** Embedded / smallest footprint?**→ Kitten (20–30MB)\n\n## 7. Developer Decision Guide\n\nCombined across all the trends above, here’s how to choose your stack in mid-2026:\n\n| Your Scenario | TTS Pick | STT Pick | Rationale |\n|---|---|---|---|\nOffline / privacy non-negotiable | Supertonic / Kokoro | Whisper variant (browser-whisper) | Quality is production-grade; data never leaves the device |\nHighest quality, cloud OK | Gemini 3.1 Flash / ElevenLabs v3 | OpenAI Whisper API | Best emotional expressiveness or overall naturalness |\nBuilding a voice agent, fast | OpenAI Realtime API (single call) | Built-in | Eliminates 3-service orchestration |\nBrowser-first user experience | Kokoro / Supertonic (both WebGPU) | browser-whisper | Zero install, zero config, fully offline |\nLow-cost at scale | Kokoro self-hosted ($0.65/1M chars) | Whisper.cpp | 100×+ cost reduction vs commercial APIs |\nVoice cloning (quick) | Kokoro + KokoClone | — | 3–10 seconds of reference audio |\nVoice cloning (high quality) | Piper Training Suite | — | Train once, deploy everywhere |\nEmbedded / IoT | Kitten TTS / MOSS-TTS-Nano | Moonshine | Tiny models, extremely fast inference |\n\n## 8. Summary\n\nThe most important trend of H1 2026 is not any single release — it’s **convergence**:\n\nOn-device quality is catching up to cloud.The Elo gap has shrunk from 223 to 81 — a 64% reduction — and open-weight models could crack the top 10 within a year.\n\nCloud APIs are simplifying architectures.The three-stage pipeline is becoming a single call, making voice agent development dramatically easier.\n\nOpen-source models now cover formerly commercial-only capabilities.Emotion control, multi-speaker dialogue, zero-shot voice cloning — all achievable locally.\n\nThe browser is becoming a viable runtime.WebGPU enables 82MB TTS and 76MB STT models to run in a browser tab in real-time, offline, with zero installation.\n\nThe result is a TTS/STT ecosystem that offers better options at every point on the quality–cost–privacy spectrum. Whether you are building a voice assistant, an audiobook platform, a video dubbing tool, game characters, or an accessibility feature:\n\n**If you haven’t put voice in your product yet, 2026 is the year to start.**\n\n*Based on offlinetts.com blog coverage (April–May 2026). Sources include official announcements from xAI, OpenAI, Google, and Supertone; the Artificial Analysis Speech Arena leaderboard; GitHub repository activity; and community discussions.*\n\n### Reference Articles (from offlinetts.com)\n\n| Title | Date |\n|---|---|\n|", "url": "https://wpnews.pro/news/tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open", "canonical_source": "https://offlinetts.com/blog/tts-stt-landscape-h1-2026/", "published_at": "2026-07-17 00:00:00+00:00", "updated_at": "2026-07-20 14:08:33.137493+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "generative-ai", "ai-products", "ai-infrastructure"], "entities": ["Supertonic", "Supertone Inc.", "Kokoro", "ToBe SAID", "StyleTTS 2", "Google WaveNet", "Amazon Polly Neural", "OfflineTTS"], "alternates": {"html": "https://wpnews.pro/news/tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open", "markdown": "https://wpnews.pro/news/tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open.md", "text": "https://wpnews.pro/news/tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open.txt", "jsonld": "https://wpnews.pro/news/tts-stt-landscape-in-spring-summer-2026-on-device-breakthroughs-api-and-open.jsonld"}}