TikTok users may soon encounter a surge in advertisements featuring digital avatars powered by artificial intelligence (AI), helping brands to create and localize content more effectively.
This feature, including "stock avatars" and "AI dubbing," will be part of the new TikTok creative AI suite called TikTok Symphony.
These stock avatars are generated from videos of real paid actors, licensed for commercial use. Brands can select an AI-powered voice and accent to read out scripts, which will then be dubbed onto the avatars.
Did you know?
Want to get smarter & wealthier with crypto?
Subscribe - We publish new crypto explainer videos every week!
What is Web3? (Animated Explanation + Examples)
This feature uses text-to-speech technology to match the dubbed voices with the actors' lip movements, supporting multiple languages, including English, Spanish, German, and Japanese. This tool can also detect the input language and translate it into the target language, making content accessible to a broader audience. The AI can generate the script itself, too.
Currently in beta, the AI avatars, translation, and dubbing features are available to a limited number of users through a waitlist.
Additionally, TikTok is testing "custom avatars" that replicate popular content creators and brand representatives. These custom avatars also have the same multilingual abilities as the stock versions.
Videos created with TikTok's AI tools will automatically be labeled as "AI-generated," ensuring the viewers are aware of the content's origin.
The technology still faces issues, such as mismatched mouth movements and gestures. Nonetheless, the feature is set to simplify content localization and creation.
In other news, AI startup Synthesia has recently enhanced its AI avatars, enabling them to display accurate emotional reactions.