Multilingual video dubbing—a technology review and current challenges

Bigioi, Dan, & Corcoran, Peter. (2023). Multilingual video dubbing—a technology review and current challenges. Frontiers in Signal Processing, 3. doi:10.3389/frsip.2023.1230755

Abstract

The proliferation of multi-lingual content on today’s streaming services has created a need for automated multi-lingual dubbing tools. In this article, current state-of-the-art approaches are discussed with reference to recent works in automatic dubbing and the closely related field of talking head generation. A taxonomy of papers within both fields is presented, and the main challenges of both speech-driven automatic dubbing, and talking head generation are discussed and outlined, together with proposals for future research to tackle these issues.

Funder

Science Foundation Ireland

Publisher

Frontiers Media

Rights

Attribution 4.0 International

cb

Collections

Electrical and Electronic Engineering (Scholarly Articles)