The cutting-edge AI video creation platform D-ID has unveiled a revolutionary tool designed for converting videos into various languages employing AI technology. Uniquely, this innovation not only translates but also replicates the original speaker’s voice and syncs their lip movements with the translation, enhancing the realism in the AI-generated videos.
This breakthrough is a continuation of D-ID’s prior innovations, which gained massive attention for enabling users to animate and give voices to vintage family photographs. Following this success, the company successfully raised $25 million in a Series B funding round in 2022, intent on catering to a growing clientele of enterprise users in the United States by offering sophisticated AI-driven video solutions.
D-ID’s newly introduced AI Video Translate technology, now accessible to D-ID subscribers at no additional cost, permits users to effortlessly convert their videos into up to 30 different languages, including but not limited to Arabic, Mandarin, Japanese, Hindi, Spanish, and French. Subscription packages begin at $56 annually for the most basic plan, offering a limited quota for utilizing AI functionalities, with prices escalating to $1,293 yearly prior to transitioning to bespoke enterprise solutions.
The innovative AI video technology championed by D-ID promises substantial cost savings on localization for businesses aiming to globalize their marketing, entertainment, or social media campaigns. This technology positions itself as a frontrunner amidst alternatives for both traditional dubbing and AI-enhanced video modifications.
Historically, dubbing services have simplified the process for audiences to enjoy videos in their preferred languages, yet they often remained beyond the reach of indie creators. This scenario is evolving as technological advancements democratize access. YouTube, for instance, rolled out a feature allowing creators to multilingually translate their video’s audio, with the renowned MrBeast (Jimmy Donaldson) leveraging this technology to introduce his content in additional 11 languages.
The domain of AI continues to broaden its horizons with capabilities like voice creation, translation, and cloning. Microsoft has disclosed plans to integrate AI for live translation and dubbing of YouTube and other videos. Vimeo, in July, debuted AI-powered functionalities to translate audio and captions while mimicking the original speaker’s voice. A plethora of entities offer services in voice cloning or AI translation (some offering both), such as Descript, ElevenLabs, Speechify, Veed, Camb.ai, Captions.ai, and Akool. Moreover, platforms like HeyGen, Deepbrain AI, and others provide the tools for crafting AI avatars capable of speaking multiple languages.
Innovations in dubbing and lip-sync AI technologies, such as Wav2lip, are facilitating easier development of these tools, promising creators both simplicity and cost-effectiveness in employing AI technologies. (D-ID’s proprietary model named Rosetta-1 is the driving force behind the new AI Video Translate functionality.)
D-ID has announced that its innovative Video Translation service will be accessible through the D-ID Studio and its API, along with a one-month trial and demonstrations available on its website.
Regarding video criteria, the company specifies that videos should range from 10 seconds to 5 minutes in length and be under 2GB in file size. To achieve optimal results, the video should feature a single individual, positioned centrally and facing the camera with their face clearly visible throughout.
Compiled by Techarena.au.
Fanpage: TechArena.au
Watch more about AI – Artificial Intelligence
