Introducing Voice Isolator Inworld AI released Voice Isolator, its first open-source model, under the Apache 2.0 license with code and weights on GitHub and Hugging Face. Voice Isolator runs at 48 kHz and ships as two checkpoints: an offline model for recorded audio and a realtime streaming model with 20 ms of look-ahead, both trained to preserve speech, laughter and breaths while removing background chatter, music and transients. Inworld AI said its models scored best among the open-source denoisers it tested on VIBE (Voice Isolation Benchmark and Evals), a private multilingual benchmark the company built and has not yet published. Introducing Voice Isolator Remove background noise while keeping speech, laughter and breaths. Two 48 kHz models, for offline processing and for realtime streaming, with code and weights under Apache 2.0. View on GitHub ↗ https://github.com/inworld-ai/voice-isolator Hugging Face ↗ https://huggingface.co/inworld/voice-isolator Today we're releasing our first open-source model: Voice Isolator . It keeps the voice as it was recorded, with its timbre, breaths and level, and removes background chatter, music and transients. It works at 48 kHz and ships as two checkpoints: an offline model for the best quality on existing recordings, and a realtime model that streams with 20 ms of look-ahead for live applications. 01Purpose Removing traffic, music or someone talking in the background is half the job. The other half is keeping the person you want to hear. Most denoisers treat a laugh, a breath or a sigh as noise and take it out. Voice Isolator is trained to keep them. Listen to it on four noisy clips. Switch isolation off to hear what the microphone captured. In a live conversation, those sounds tell a voice agent a lot: a breath before someone speaks, a laugh in response, or an "hmm" while they think. Keeping them helps the agent decide when to respond https://inworld.ai/blog/introducing-sava . In a recorded interview or a voice sample, they keep the character of the original voice. 02Evals We built VIBE Voice Isolation Benchmark and Evals to measure how well a model preserves the original voice while removing everything else. It is a multilingual, multi-condition set of real utterances, with and without added noise, and we use it to score open-source models against each other. Our models performed best among the open-source denoisers we were able to test. VIBE is a private benchmark for now. If you'd like to submit a model, or help improve Voice Isolator or the benchmark itself, reach out https://github.com/inworld-ai/voice-isolator/issues and we'll be happy to collaborate. 03How to Start with a recording you know well. Install the package, then run it on the file using the commands below. The weights download from Hugging Face https://huggingface.co/inworld/voice-isolator on first use. The model runs on CUDA, Apple silicon and CPUs. pip install inworld-voice-isolation the voice goes to clean.wav, what was removed to clean background.wav voice-isolate noisy.wav clean.wav the realtime model, as a stream voice-isolate noisy.wav clean.wav --mode streaming --lookahead 2 python from inworld import voice isolation live = voice isolation.VoiceIsolator "inworld/voice-isolator", mode="streaming", lookahead frames=2 session = live.stream 48 kHz mono, in pieces of any size for piece in microphone: play session.push piece the samples that are final play session.flush To hear it for yourself, run the repository's interactive demo https://github.com/inworld-ai/voice-isolator/blob/main/demo/README.md on your laptop. It has a tab for recorded files and another that sends microphone audio through the realtime model. 04Next Voice Isolator currently only does denoising. We trained it this way on purpose, so that it introduces no bias into downstream training tasks or into realtime speech-to-text models, which can be sensitive to changes in the waveform. But denoising alone won't fix a low-quality microphone or missing band detail. That is restoration. We're looking at it, and we may have something to share. We'd like to hear how Voice Isolator works in your application. If you have an idea for making it better, or you found something that doesn't work well, create an issue https://github.com/inworld-ai/voice-isolator/issues or ask your agent to open a pull request, and we'll respond. Let's make it better together.