Amazon Prime Video’s new AI tech matches lips to dubbed audio

Amazon Prime Video launched an AI-powered lip-sync feature that aligns actors' mouth movements with dubbed audio, initially available for the English dub of the German series Maxton Hall seasons 1 and 2, with season 3 arriving December 9th. The feature uses AI and visual effects to match lips to translated speech, following similar tools from Meta and YouTube, and expands on Prime Video's earlier AI-aided dubbing experiments across 12 titles.

Amazon’s Prime Video is launching a new AI-powered feature that lines up an actor’s mouth with “human-dubbed” audio. The feature is only available https://www.aboutamazon.com/news/entertainment/prime-video-lip-sync-technology with the English dub of the German series Maxton Hall for now, but Prime Video plans to expand it to “additional titles” in the future. Amazon Prime Video’s new AI tech matches lips to dubbed audio The new Prime Video feature is only available with the English dub of Maxton Hall for now. In its announcement, Prime Video says it uses a combination of AI and visual effects technologies to make lip movements match up with translated speech. Meta /news/761665/meta-ai-translation-facebook-instagram-reels and YouTube recently launched /news/778469/youtube-creators-ai-analytics-ask-studio-dubbing an AI-powered auto-dubbing feature for creators, while allowing them to turn on a “lip sync” option to make it look like creators are actually speaking in a user’s preferred language. Last year, Prime Video began experimenting with “AI-aided” dubbing https://www.aboutamazon.com/news/entertainment/prime-video-ai-dubbing-english-spanish in English and Spanish across 12 movies and TV shows, including El Cid: La Leyenda , Mi Mamá Lora , and Long Lost . The streamer’s lip-sync dubbing is currently available for seasons 1 and 2 of Maxton Hall for subscribers around the globe, and will launch with the show’s third season coming December 9th. Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.