Nvidia Nemotron 3.5 Transcribe: open speech-to-text, no streaming
Nvidia's Nemotron 3.5 Transcribe is an open-weight speech-to-text model for 40 languages and hour-long audio. It's batch-only. Here's where it fits.
Nvidia released Nemotron 3.5 Transcribe on October 28: a free, open-weight speech-to-text model that handles 40 languages and recordings up to an hour long, with a license that allows commercial use. If you pay per minute to transcribe sales calls, support calls or meetings, you now have a self-hostable option from a vendor that isn't going away. One catch up front: it doesn't stream. It's built for recordings, not live calls.
What actually happened
TechCrunch reported the launch, and the details are in Nvidia's Hugging Face model card:
- Size: about 34B total parameters, roughly 4.3B active per token (a mixture-of-experts design, which is why the name says "30B-A4B").
- License: OpenMDW-1.1. The card states it's ready for commercial or non-commercial use.
- Languages: 40 for transcription. Audio reasoning and spoken-instruction features were evaluated in English only.
- Length: recordings up to one hour, with speaker tags in the output. The training data includes mixes of up to eight speakers.
- Input: WAV, FLAC, MP3, OGG, or anything that decodes to 16 kHz mono PCM.
- Streaming: none. The card calls it an offline model.
- Hardware: the quick start targets a single H100 80GB. FP8 and NVFP4 quantized variants are listed for smaller footprints.
- Nvidia's numbers: 4.71% mean word error rate on the English Open ASR Leaderboard, 4.62% on the multilingual set, and 15.80% on hard multi-speaker sets like meeting recordings. These are vendor-reported.
Nvidia also shipped an updated open speech dataset, Granary v2, and its NeMo Speech tools so teams can tune the model on their own industry terms.
Why it matters for your business
Most small businesses already record calls. Few do anything with those recordings, because transcription at volume costs real money and every vendor wants a per-minute fee. An open model with a commercial license changes the math. You run it once a night against yesterday's calls, then feed the text to whatever does the summarizing, tagging and CRM updates.
The batch-only design is the honest limit. If you want a voice agent that answers the phone, this is the wrong tool; you need a streaming model for that. For call-log analysis, meeting notes and compliance archives, batch is fine, and usually cheaper.
Do the math before you switch. A rented H100 isn't free, and hosted transcription APIs now charge cents per hour of audio, so at low volume the API can still win. Price your own monthly hours against GPU rental before you move anything. Test it on 50 of your own recordings, with your own accents and product names, before you trust the leaderboard.
Key takeaways
- Nemotron 3.5 Transcribe is open-weight, commercially licensed, and covers 40 languages
- It handles recordings up to an hour, with speaker tags, but does not stream
- Good fit: nightly batch transcription of calls and meetings; bad fit: live voice agents
- Self-hosting needs serious GPU; compare against per-hour API pricing at your volume
- Benchmark claims are Nvidia's; test on your own audio first
Sitting on months of call recordings? We build batch pipelines that turn them into searchable notes, tagged leads and CRM updates, on hosted or self-hosted models. See what the hours are worth, or tell us your call volume.
Sources: Hugging Face: NVIDIA Nemotron 3.5 Transcribe model card, TechCrunch.
- #speech-to-text
- #nvidia
- #nemotron
- #open-weight
- #transcription
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
OpenAI plans to buy Google TPUs: what it means for your AI bill
OpenAI plans to buy Google TPUs, per The Information and Bloomberg. No terms yet. Why AI chip supply shifts matter to your API costs and model routing.
Read itApple adds MCP to Pages, Keynote, Numbers: AI agents edit docs
Apple's Pages, Keynote and Numbers get MCP support on macOS 27, so outside AI agents can read and edit your documents. What to automate and what to lock down.
Read it