YouTube is introducing a new AI-powered dubbing tool here is how it works

A new AI-powered tool that will aid viewers worldwide in overcoming language barriers has been implemented into YouTube. Google's video-sharing platform hopes to make it simpler for users to subtitle films in other languages with Artificial intelligence. The business said the Aloudteam will work on this initiative during the US-based VidCon event.

An AI-driven dubbing service called Aloud is offered by Google's Area 120 incubator.

 YouTube AI dubbing: Availability

According to Amjad Hanif, who spoke with the Verge, the technology is already being tested by YouTube AI with "hundreds" of producers. Hanif also emphasized the "few" languages that Aloud presently supports. In the upcoming days, the tool is anticipated to include more languages. Only English, Spanish, and Portuguese are supported now by the Aloud dubbing tool.

According to the website for Aloud, this program transcribes videos before translating them into other languages. The user can then evaluate and amend the transcriptions using the tool. The dubbing for the video is then produced and translated. The Google Cloud team has also provided a video demonstrating how it functions.

 How Will It Help Creators?

Even when they only speak a few languages, developers may still use aloud as a valuable tool. This tool may be helpful as more producers are allowed to include multi-language dubs in their videos.

The next few days would see YouTube "working to make translated audio tracks sound like the creator's voice, with more expression, and with lip sync," Hanif said. According to reports, the corporation intends to provide these functions in 2024.

The business started utilizing Google DeepMind's AI last month to create descriptions for YouTube Shorts. By examining the first few frames of a video, the business created explanations using the Flamingo visual language paradigm.