--- id: "2026-08-03-nvidia-nemotronlabs-voicechat" url: "https://postcutoff.com/e/2026-08-03-nvidia-nemotronlabs-voicechat/" as_of: "2026-11-13T13:49:00+01:00" date: "2026-08-03" date_precision: day category: open-source importance: 3 confidence: medium status: [Partly confirmed] sources: 3 editor: human editor human_review: null version: "2026-10-04" --- As of: 2026-11-13 13:49 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-08-03-nvidia-nemotronlabs-voicechat/ # NVIDIA releases NemotronLabs VoiceChat 11B, an open full-duplex voice model with tool calling NVIDIA published NVIDIA-NemotronLabs-VoiceChat-11B on Hugging Face (card dated 2026-08-03; arXiv 2609.21967): an end-to-end, full-duplex speech-to-speech model (FastConformer encoder + Nemotron Nano v2 9B + TTS decoder) that NVIDIA calls the first open full-duplex model to support tool calling. It has ~450 ms turn-taking latency and ranks #2 among open models on VoiceBench and Full-Duplex-Bench. ## Key facts - 11B params; English; OpenMDW-1.1 license - Tool calling: BFCL-v3 (AU Harness) 56.1%; Full-Duplex-Bench v3 tool selection 82.5% - Turn-taking ~450 ms; interruption latency 480 ms; smooth turn-taking 0.82 (FDB 1.0) - Part of NVIDIA's 2026 Nemotron Speech push: PersonaPlex-7B (Jan, Moshi-based), Nemotron Speech Streaming ASR, Nemotron 3.5 ASR (40 locales, June) ## What happened NVIDIA added an 11B end-to-end full-duplex voice model to its Nemotron Speech collection. It listens and speaks at the same time, and it can call external tools while keeping the conversation going. Before this, open full-duplex models did not do tool calling. ## Why it matters Open full-duplex models (Kyutai Moshi, NVIDIA PersonaPlex) were mostly chat demos. Tool calling makes an open, self-hostable alternative to cascaded ASR→LLM→TTS agents and to closed realtime APIs possible. The "first" is NVIDIA's own claim. The release date comes from the model card; we found no separate press release. ## Your AI and this story - GPT-6 Astra (training cutoff April 2026): 95 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 34 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 125 days after its cutoff - Grok 4.7 (training cutoff May 2026): 64 days after its cutoff ## Sources 1. [Hugging Face: NVIDIA-NemotronLabs-VoiceChat-11B](https://huggingface.co/nvidia/NVIDIA-NemotronLabs-VoiceChat-11B) (huggingface.co, code) 2. [arXiv 2609.21967: NemotronLabs VoiceChat](https://arxiv.org/abs/2609.21967) (arxiv.org, paper) 3. [Hugging Face collection: Nemotron Speech](https://huggingface.co/collections/nvidia/nemotron-speech) (huggingface.co, code) ## Changes - 2026-09-29 (filed): Created ## Related - 2026-09-15: [Google ships Gemini 3.8 Live voice models and Gemini 3.8 Flash TTS with voice design and cloning](https://postcutoff.com/e/2026-09-15-gemini-3-8-live-and-tts/index.md) - 2026-07-08: [OpenAI launches GPT-Live, full-duplex voice models replacing ChatGPT's Advanced Voice Mode](https://postcutoff.com/e/2026-07-08-openai-gpt-live-chatgpt-voice/index.md) - Models: [NVIDIA NemotronLabs VoiceChat 11B (and PersonaPlex-7B)](https://postcutoff.com/m/nemotron-voicechat/) (`nemotron-voicechat`)