D-ID Startup Introduces AI Tool for Translating Videos with Automatic Dubbing
The D-ID startup, which created one of the popular platforms for generating videos using AI, has introduced a new tool for automatically translating videos into other languages. Its main feature is that it immediately plays the auto-dubbing with the original speaker’s voice and changes the movements of their lips in accordance with the translated words.
The technology is based on the startup’s previous project, which allowed animating old photos, bringing people to life and voicing them.
Currently, the tool can translate into 30 languages, including Spanish, French, Japanese, Arabic, Russian, Hindi, and others.
At the moment, the tool can work with videos from 10 seconds to 5 minutes long, and the file size should not exceed 2 GB. Translation is performed only on videos with one person in the frame, and for the best dubbing result, their face should look directly into the camera.
D-ID suggests that the new video translation technology can help corporate clients save money on localizing their video content. The tool is currently available to users who have a paid subscription to the startup’s platform. The video translation technology will also be available to developers as an API.
