{"slug": "rumble-2-flash-an-open-0-5b-speech-model-for-40-languages", "title": "Rumble-2-Flash: an open 0.5B speech model for 40+ languages", "summary": "Reson8 open-sourced Rumble-2-Flash, a 0.5B-parameter speech recognition model covering 40+ languages, under the Apache 2.0 license. Rumble-2-Flash averages a 6.96% error rate across nine languages on the Open ASR Leaderboard multilingual track, beating Meta's omniASR-LLM 7B (15x larger) and Whisper large-v3, and reaches over 7,000 RTFx on full batches, transcribing an hour of audio in about half a second. Reson8 built the model by distilling its larger Rumble-2 production model with on-policy distillation, using the GOLD method to bridge mismatched tokenizers, and reports it is on par with NVIDIA's Nemotron 3.5 Transcribe (30B) on a 302-hour call-centre benchmark.", "body_md": "[Automatic Speech Recognition •  0.5B • Updated   •  453  •  18](https://huggingface.co/Reson8/Rumble-2-Flash)  \n\n# \n\t\tRumble-2-Flash: an open 0.5B speech model for 40+ languages\n\t\n\n [Update on GitHub](https://github.com/huggingface/blog/blob/main/rumble-2-flash.md)\n\nToday we're open sourcing [Rumble-2-Flash](https://huggingface.co/Reson8/Rumble-2-Flash) under the Apache 2.0 license. It's a 0.5B-parameter speech recognition model for 40+ languages that competes with models 3-60x its size.\n\n- **Runs anywhere** : native support in 🤗 Transformers and vLLM, no custom code\n- **40+ languages** : automatic language detection\n- **Output control** : numbers as digits or words, fillers, verbatim repeats, forced language\n- **Extremely fast** : an hour of audio in about half a second, with over 7,000 RTFx on full batches\n- **Holds up on real phone calls** : on par with NVIDIA's Nemotron 3.5 Transcribe (30B) on a 302-hour call-centre benchmark\n\n## \n\t\tQuickstart\n\t\n\n## Transcribe with 🤗 Transformers\n\n```\nuv pip install torch transformers accelerate\npython\nfrom transformers import AutoProcessor, AutoModelForMultimodalLM\n\nmodel_id = \"Reson8/Rumble-2-Flash\"\nprocessor = AutoProcessor.from_pretrained(model_id)\nmodel = AutoModelForMultimodalLM.from_pretrained(model_id, device_map=\"auto\")\n\ninputs = processor.apply_transcription_request(\n    audio=\"https://hf.co/datasets/hf-internal-testing/dummy-audio-samples/resolve/main/bcn_weather.mp3\",\n    language=\"English\",  # omit to detect automatically\n).to(model.device, dtype=model.dtype)\n\noutput = model.generate(**inputs, max_new_tokens=512)\ngenerated = output[:, inputs[\"input_ids\"].shape[-1]:]\nprint(processor.decode(generated, return_format=\"transcription_only\")[0])  # return_format=\"parsed\" if detecting language\n```\n\n`audio` accepts a local path, a URL, a NumPy array, or a list of these.\n\n## \n\t\tHow it's built\n\t\n\nRumble-2-Flash uses the Qwen3-ASR architecture for day-0 support. If your stack runs Transformers or vLLM, it runs Rumble-2-Flash, with no forked runtime or `trust_remote_code`.\n\nTo find out how small a model could get before accuracy dropped off, we distilled Rumble-2, our larger production model, into it with on-policy distillation. The student doesn't train on transcripts the teacher wrote. It transcribes the audio itself, and the teacher grades that transcript token by token: at every position, it gives its own probability for what should come next, and the student learns to match it. Because the student learns from its own outputs, it gets corrected on exactly the mistakes it makes, with feedback on every token instead of one score per clip.\n\nOn-policy distillation normally requires teacher and student to share a tokenizer, and ours don't: choosing Qwen3-ASR meant taking its vocabulary too. [GOLD](https://huggingface.co/spaces/HuggingFaceH4/on-policy-distillation) removes that restriction. It merges tokens where the two tokenizers split the text differently, so both models are compared over the same text. Tokens that exist in both vocabularies are compared directly, and the rest by their sorted probabilities.\n\n## \n\t\tResults\n\t\n\n### \n\t\tAccuracy for its size\n\t\n\nOn the Open ASR Leaderboard [multilingual](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard?languages=Reson8%2FRumble-2-Flash&proprietary=false) track, Rumble-2-Flash averages a **6.96% error rate** across Chinese, German, French, Italian, Spanish, Portuguese, Hindi, Dutch and English. That's better than Meta's omniASR-LLM 7B, a model 15x larger, and ahead of Whisper large-v3. On the [English](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard) track it averages **6.6% WER**.\n\n### \n\t\tSpeed\n\t\n\nRumble-2-Flash is also fast. Its throughput depends on how full the batches are: on the larger datasets in HF's Open ASR Leaderboard, where batches stay full, it reaches **over 7,000 RTFx**. That's an hour of audio in about half a second.\n\n### \n\t\tReal phone calls\n\t\n\nClean audio is easy. Phone calls are compressed and noisy, and often have speakers with very different accents. On [AppTek's call-centre benchmark](https://huggingface.co/datasets/apptek-com/apptek_callcenter_dialogues) (302 hours of helpline calls, 14 English accents, scored with AppTek's own script), Rumble-2-Flash reaches **7.86% WER**, on par with NVIDIA's Nemotron 3.5 Transcribe (30B) at 7.78%. That's well ahead of Qwen3-ASR 0.6B (8.7%), from the same model family, and close to Qwen3-ASR 1.7B (7.4%), the only model in the comparison that does better.\n\n## \n\t\tTry it\n\t\n\nThe weights are on the Hub at [Reson8/Rumble-2-Flash](https://huggingface.co/Reson8/Rumble-2-Flash). It's also available through our [API](https://www.reson8.dev).\n\nWe're very curious what you'll build with it. Tell us in the [Discussions tab](https://huggingface.co/Reson8/Rumble-2-Flash/discussions) what you've made, what you like, and what you'd like to see changed in a next version.", "url": "https://wpnews.pro/news/rumble-2-flash-an-open-0-5b-speech-model-for-40-languages", "canonical_source": "https://huggingface.co/blog/rumble-2-flash", "published_at": "2026-11-18 00:00:00+00:00", "updated_at": "2026-11-18 14:43:20.623804+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "natural-language-processing", "ai-research"], "entities": ["Reson8", "Rumble-2-Flash", "Rumble-2", "Qwen3-ASR", "Meta", "omniASR-LLM 7B", "Whisper large-v3", "NVIDIA"], "also_reported_by": [], "takeaway": "Rumble-2-Flash is a 0.5B Apache 2.0 ASR model with native Transformers and vLLM support that hits 6.96% average error across nine languages and over 7,000 RTFx, so it can replace models 3-60x larger without custom runtime code.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/rumble-2-flash-an-open-0-5b-speech-model-for-40-languages", "markdown": "https://wpnews.pro/news/rumble-2-flash-an-open-0-5b-speech-model-for-40-languages.md", "text": "https://wpnews.pro/news/rumble-2-flash-an-open-0-5b-speech-model-for-40-languages.txt", "jsonld": "https://wpnews.pro/news/rumble-2-flash-an-open-0-5b-speech-model-for-40-languages.jsonld"}}