[Late catch] Nemotron 3.5 Transcribe: NVIDIA's open-weight model for transcription, speaker labels and translation in 40 languages
What is it?
Nemotron 3.5 Transcribe is an open-weight model that turns recorded speech into text. It's a mixture-of-experts (MoE) model with 34B parameters in total, of which about 4.3B are active per token. It transcribes 40 languages, translates 31 of them to or from English, and labels up to eight speakers in recordings up to an hour long. You can steer the output format or the spelling of domain terms with plain-language instructions, and it ships in BF16, FP8 and NVFP4. It loads directly in Transformers.
pip install -U transformers accelerateWhy does it matter?
NVIDIA says it posts the lowest error rates among open-weight models: a 4.71% mean WERVendor claim across the nine English sets of the Hugging Face Open ASR Leaderboard and 4.62%Vendor claim across seven languages. That means a single model can power meeting notes, call centers or medical dictation where you need speaker labels and translation together, and it runs on your own GPUs so audio never leaves your network. NVIDIA also released the Granary v2 training data and fine-tuning recipes, which makes adapting it to domain vocabulary easier.
Maturity
GAWe rated it GA because anyone can download the weights and the model card allows commercial use. The headline speed of 2,238 seconds of audio per second on one RTX PRO 6000Vendor claim relies on NIM-only optimizations, though; NVIDIA says the open-source vLLM path is roughly twice as slow.
How to track it
- Independent results: check where it actually lands on the Hugging Face Open ASR Leaderboard and Artificial Analysis speech rankings.
- Running it locally: watch NeMo Speech on GitHub for the NIM optimizations and for a release date for quantized builds.
- License: read the OpenMDW-1.1 terms on the model card before shipping it in a commercial product.