Build Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie TTS

Voice interactions have a latency budget, with the final step being text-to-speech (TTS) that users notice most. NVIDIA Magpie Multilingual TTS offers low-latency deployment control and open weights for fine-tuning domain-specific components. With support for 12 languages, including the addition of Modern Standard Arabic, Korean, and Brazilian Portuguese, Magpie provides open foundation models for production voice AI.

The architecture includes frame stacking, predicting two audio frames per decoding step, and a local transformer refining generated audio to maintain quality while improving efficiency. These improvements result in faster generation and natural speech synthesis. Compared to previous releases, Magpie shows reduced character error rates and higher speaker similarity on many languages, with notable improvements in French and Spanish.