Prime Video is implementing a new AI-powered system designed to synchronize actors' lip movements with human-dubbed audio, aiming to eliminate the visual disconnect typical of traditional dubbing. The technology debuts with the English dub of the German series Maxton Hall, specifically for seasons 1 and 2, with further integration planned for the third season arriving on December 9.
Hybrid AI and VFX Pipeline
The system operates through a combination of artificial intelligence and visual effects (VFX) technologies. Unlike fully automated generative dubbing, this approach uses AI to adjust the visual geometry of the mouth to match translated speech while maintaining creative oversight. This hybrid pipeline ensures that immersion is boosted without sacrificing the quality of the original performance.
A Growing Trend in Streaming
This move follows a broader industry shift toward AI-enhanced localization. Meta and YouTube have recently introduced similar auto-dubbing features with lip-sync options for creators, a trend previously analyzed by AlexTech.ai regarding Meta's AI voice translations for Reels.
Amazon has been incrementally testing these capabilities; last year, the streamer experimented with AI-aided dubbing across 12 titles in English and Spanish. The deployment on Maxton Hall—the platform's most-watched international original to date—marks the first official rollout of this specific lip-sync technology for subscribers worldwide, with plans to expand it to additional titles in the future.
No comments yet. Be the first!