{"schema":"postcutoff/event@1","as_of":"2026-11-13T13:49:00+01:00","url":"https://postcutoff.com/e/2026-08-03-nvidia-nemotronlabs-voicechat/","md":"https://postcutoff.com/e/2026-08-03-nvidia-nemotronlabs-voicechat/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-08-03-nvidia-nemotronlabs-voicechat","date":"2026-08-03","date_precision":"day","short_title":"NVIDIA releases NemotronLabs VoiceChat 11B, an open full-duplex voice model with tool calling","deck":null,"takeaway":null,"category":"open-source","category_label":"Open source","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"Hugging Face: NVIDIA-NemotronLabs-VoiceChat-11B","url":"https://huggingface.co/nvidia/NVIDIA-NemotronLabs-VoiceChat-11B","type":"code","group":"primary","domain":"huggingface.co"},{"n":2,"title":"arXiv 2609.21967: NemotronLabs VoiceChat","url":"https://arxiv.org/abs/2609.21967","type":"paper","group":"primary","domain":"arxiv.org"},{"n":3,"title":"Hugging Face collection: Nemotron Speech","url":"https://huggingface.co/collections/nvidia/nemotron-speech","type":"code","group":"primary","domain":"huggingface.co"}],"official":3,"filed":"2026-09-29","updated":"2026-09-29","orgs":["NVIDIA"],"title":"NVIDIA releases NemotronLabs VoiceChat 11B, an open full-duplex voice model with tool calling","summary":"NVIDIA published NVIDIA-NemotronLabs-VoiceChat-11B on Hugging Face (card dated 2026-08-03; arXiv 2609.21967): an end-to-end, full-duplex speech-to-speech model (FastConformer encoder + Nemotron Nano v2 9B + TTS decoder) that NVIDIA calls the first open full-duplex model to support tool calling. It has ~450 ms turn-taking latency and ranks #2 among open models on VoiceBench and Full-Duplex-Bench.","key_facts":["11B params; English; OpenMDW-1.1 license","Tool calling: BFCL-v3 (AU Harness) 56.1%; Full-Duplex-Bench v3 tool selection 82.5%","Turn-taking ~450 ms; interruption latency 480 ms; smooth turn-taking 0.82 (FDB 1.0)","Part of NVIDIA's 2026 Nemotron Speech push: PersonaPlex-7B (Jan, Moshi-based), Nemotron Speech Streaming ASR, Nemotron 3.5 ASR (40 locales, June)"],"key_numbers":[],"tags":["speech","full-duplex","voice-agents","open-weights","tool-use","voice"],"science":null,"body_md":"## What happened\n\nNVIDIA added an 11B end-to-end full-duplex voice model to its Nemotron Speech collection. It listens and speaks at the same time, and it can call external tools while keeping the conversation going. Before this, open full-duplex models did not do tool calling.\n\n## Why it matters\n\nOpen full-duplex models (Kyutai Moshi, NVIDIA PersonaPlex) were mostly chat demos. Tool calling makes an open, self-hostable alternative to cascaded ASR→LLM→TTS agents and to closed realtime APIs possible. The \"first\" is NVIDIA's own claim. The release date comes from the model card; we found no separate press release.","disputed":[],"related":[{"id":"2026-09-15-gemini-3-8-live-and-tts","url":"https://postcutoff.com/e/2026-09-15-gemini-3-8-live-and-tts/","date":"2026-09-15","date_precision":"day","short_title":"Google ships Gemini 3.8 Live voice models and Gemini 3.8 Flash TTS with voice design and cloning","deck":null,"takeaway":"Completes a full voice stack (transcription, reasoning, real-time dialogue, speech synthesis, cloning) on one API; voice cloning also raises misuse concerns.","category":"product","category_label":"Products","importance":2,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":12,"official":10,"filed":"2026-09-29","updated":"2026-09-30","orgs":["Google"]},{"id":"2026-07-08-openai-gpt-live-chatgpt-voice","url":"https://postcutoff.com/e/2026-07-08-openai-gpt-live-chatgpt-voice/","date":"2026-07-08","date_precision":"day","short_title":"OpenAI launches GPT-Live, full-duplex voice models replacing ChatGPT's Advanced Voice Mode","deck":null,"takeaway":"ChatGPT's default voice experience moved to a full-duplex model with a separate \"thinker\" behind it, narrowing the gap between natural conversation and capable agents for one of the largest voice-assistant user bases.","category":"model-release","category_label":"Model releases","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":8,"official":4,"filed":"2026-09-29","updated":"2026-10-16","orgs":["OpenAI"]}],"people":[],"posts":[],"videos":[],"models":[{"id":"nemotron-voicechat","name":"NVIDIA NemotronLabs VoiceChat 11B (and PersonaPlex-7B)","url":"https://postcutoff.com/m/nemotron-voicechat/"}],"changes":[{"date":"2026-09-29","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":95,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":34,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":125,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":64,"in_training_data":false}],"short_url":null}