Sign In

Communications of the ACM

ACM TechNews

Deepfake Software Translates Videos from One Language to Another


View as: Print Mobile App Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook
India has 22 official languages.

Researchers at Indias International Institute of Information Technology have developed software that can translates a video of a person speaking in one language into another language, while matching their lip movements to the new words.

Credit: Helene Rogers/Art Directors & TRIP/Alamy Stock Photo

Researchers at India’s International Institute of Information Technology (IIIT) developed software that automatically translates a video of a person speaking in one language into another language, while matching their lip movements to the new words.

The LipGAN algorithm is actually several algorithms functioning in concert, with one recognizing the words being spoken, and another translating the words into a target language. A text-to-speech algorithm produces the new sounds, while yet another algorithm animates synchronizes lip movements and facial movements with words spoken in the new language.

IIIT's Prajwal Renukanand suggested the technology could help translate TV shows or movies for international audiences.

From New Scientist
View Full Article

 

Abstracts Copyright © 2020 SmithBucklin, Washington, DC, USA


 

No entries found