Disney puts words in your mouth with advanced Dubsmash tech

Disney puts words in your mouth with advanced Dubsmash tech

Disney's Research lab has come up with a new automated system that can match various phrases to mouth shapes and make it look like you're saying something you're not.

The system is "literally putting plausible words into the mouth of the speaker" which doesn't sound terrifying at all.

The researchers demonstrated the tech in a video that's not exactly on a par with Frozen, quality-wise. An actor says the line "clean swatches" (which we obviously all say all the time, can't shut us up about clean swatches) and the system synthesizes it into a robot voice which it can then use to search for phrases that use the same vocal and mouth shapes.

Gibberish generator

In the video example, alternative phrases include "die swat saw", "see dick whine a toy" and "dead lube edge it a", which you could record and dub over the actor's face and it would look like he was talking gibberish. Great!

Obviously this has some useful implications for filmmakers, who sometimes needs to change dialogue in films without reshooting whole scenes and set-ups. There's also the potential to use it for better quality dubbing when releasing films in different languages.

Evil dictators may also be interested in capturing political dissidents then releasing videos of them toeing the party line. Who's to say. Either way, hopefully it will lead to better quality Dubsmashes from your brother at 3am.

John McCann
Global Managing Editor

John joined TechRadar over a decade ago as Staff Writer for Phones, and over the years has built up a vast knowledge of the tech industry. He's interviewed CEOs from some of the world's biggest tech firms, visited their HQs and has appeared on live TV and radio, including Sky News, BBC News, BBC World News, Al Jazeera, LBC and BBC Radio 4. Originally specializing in phones, tablets and wearables, John is now TechRadar's resident automotive expert, reviewing the latest and greatest EVs and PHEVs on the market. John also looks after the day-to-day running of the site.