DiffDub: Person-Generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-Encoder [PDF]
IEEE International Conference on Acoustics, Speech, and Signal Processing, 2023 Generating high-quality and person-generic visual dubbing remains a challenge. Recent innovation has seen the advent of a two-stage paradigm, decoupling the rendering and lip synchronization process facilitated by intermediate representation as a conduit.
Tao Liu +4 more
semanticscholar +1 more source
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis [PDF]
IEEE transactions on circuits and systems for video technology (Print), 2023 Existing automated dubbing methods are usually designed for Professionally Generated Content (PGC) production, which requires massive training data and training time to learn a person-specific audio-video mapping.
Linsen Song +4 more
semanticscholar +1 more source
Jointly Optimizing Translations and Speech Timing to Improve Isochrony in Automatic Dubbing [PDF]
arXiv.org, 2023 Automatic dubbing (AD) is the task of translating the original speech in a video into target language speech. The new target language speech should satisfy isochrony; that is, the new speech should be time aligned with the original video, including mouth
Alexandra Chronopoulou +5 more
semanticscholar +1 more source
Cross-lingual Prosody Transfer for Expressive Machine Dubbing [PDF]
Interspeech, 2023 Prosody transfer is well-studied in the context of expressive speech synthesis. Cross-lingual prosody transfer, however, is challenging and has been under-explored to date.
J. Swiatkowski +5 more
semanticscholar +1 more source
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing [PDF]
AAAI Conference on Artificial Intelligence, 2022 Video dubbing aims to translate the original speech in a film or television program into the speech in a target language, which can be achieved with a cascaded system consisting of speech recognition, machine translation and speech synthesis.
Yihan Wu +9 more
semanticscholar +1 more source
’n Speelbaarheidsbenadering vir die vertaling van rolprente
Communicare, 2022 This article argues that dubbing translation involves more than “mere” translation: it is the task of the dubbing translator to create dialogue that has to be spoken by dubbing actors and, for this reason, playability can be the only true test for the ...
Louis Calitz
doaj +1 more source
Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing [PDF]
IEEE/ACM Transactions on Audio Speech and Language Processing, 2023 Automatic dubbing, which generates a corresponding version of the input speech in another language, can be widely utilized in many real-world scenarios, such as video and game localization.
Jingbei Li +9 more
semanticscholar +1 more source
Subtitling and Dubbing of Idiomatic Expressions in the American TV Series WandaVision
Lingua Cultura, 2022 The research aimed to find out the translation strategies applied in the subtitling and the dubbing of idiomatic expressions in the television series WandaVision (2021).
I Gusti Ayu Mahatma Agung
doaj +1 more source
Pendampingan peningkatan kemampuan berbicara bahasa Inggris melalui teknik dubbing film
Community Empowerment Journal, 2023 Kegiatan pengabdian kepada masyarakat ini dilakukan dengan tujuan untuk memberikan pelatihan dalam upaya peningkatan kemampuan berbicara Bahasa Inggris siswa melalui teknik dubbing film.
Mega Mulianing Maharani +3 more
doaj +1 more source
Hermes, 2018 For more than seven decades, dubbing has been the dominant professional modality for overcoming language barriers in foreign movies and TV series in Iran and has been revered as a national art.
Saeed Ameri, Masood Khoshsaligheh
doaj +1 more source