This dubbing function keeps not only the voice, but also the accent and the tone history that the result seems a natural minimum. The icing on the cake, an option of labial synchronization adjusts the lips so that everything sticks perfectly to the new soundtrack.
Automatic dubbing to widen the audience
For the moment, only English and Spanish are concerned, but Meta promises to add other languages over time. As Adam Mosseri, Instagram boss summarizes: ” Many creators have an enormous potential audience, but language is an obstacle. If we can help them cross this barrier, everyone is a winner. »»
How does it work? This function is not a good rocket science: before posting a real, just click on the option “Translate your voice with Meta Ai”, to activate or not the labial synchro, then to share. The translation is automatically added and can be pre-visited. Not satisfied? It is possible to cut it at any time, without touching the original video. Spectators will see a small banner indicating that it is a content translated by Meta AI, and those who prefer raw versions will be able to deactivate the option in their settings.
The function is open to Facebook creators with at least 1,000 subscribers, as well as all public accounts on Instagram. And to follow the effectiveness of dubbing, a new indicator in statistics allows you to see how many views come from each language.
Meta goes further by authorizing the creators to pass up to 20 audio tracks doubled with their own voice on a real. Good news for those who want to control their translations themselves, before or after publication. The idea is always the same, it is to make content understandable beyond the usual linguistic circle of the Creator.
To optimize the result, Meta advises to speak face camera, clearly, without covering her mouth or surrounding himself with too much noise. The tool only manages two speakers at a time, so we will avoid talking in choir. As for the next languages available, mystery … but there is no doubt that the list will lie down.
This novelty is a way for Meta to push the integration of AI into its services even further. For the worst and the best.