How to Dub a Video With Two Speakers Into Another Language and Keep Each Voice (Open Source)
Dubbing a video into another language is easy when one person talks. It gets hard the moment there are two speakers: a single synthetic voice for everyone makes interviews and podcasts unwatchable, and the translated sentences rarely fit the original timing. This tutorial dubs a real two-speaker clip from English into Spanish with an open-source tool, miragea-dub (MIT). Each speaker keeps their…
Dubbing a video with two speakers into another language and keeping each voice intact is a challenging task. However, the open-source tool miragea-dub makes this process easy, even if one person talks in the original clip. The tutorial explains how to dub an English video into Spanish while maintaining the original timing and the individual voices of the speakers.
Each speaker's voice is cloned from their respective lines, and the translated sentences fit into the original timing. The final result is a dubbed MP4, an audio track, and subtitles in Spanish. Miragea-dub utilizes AI technology to transcribe the video, separate the speakers, translate each line, and voice each speaker with a voice that resembles the original.
This process involves several steps: installing the necessary tools, transcribing and identifying the speakers, translating the lines with an AI agent, cloning and voicing the speakers, and finally publishing the dubbed video along with the original audio, subtitles, and a JSON report.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.