Tencent has released Hy-SimulMT, an open-source model for simultaneous Chinese-English interpretation. It processes incoming speech continuously and supports translated text and speech output, with real-time voice cloning designed to preserve the original speaker’s vocal characteristics. Users can also try the technology in Tencent’s Hy Translate app.
The release includes model weights, inference software and training tools. On the RealSI long-form audio benchmark, Tencent reported a streaming translation lag of approximately three seconds, with translation-quality scores exceeding the other open-source models and four of the five commercial APIs in its comparison. Speech generation and voice cloning require a configured text-to-speech service. [Tencent Hunyuan]