算力商业
www.aibase.com ·
NVIDIA 发布约1亿参数免费模型 Nemotron3Diarization，支持8人实时语音分割
NVIDIA 发布约1亿参数、开放权重的语音分割聚类模型 Nemotron3Diarization，可实时或离线处理最多8人同时说话的音频，自动识别各时刻说话人。该模型在 VoiceArena v1 语音分割基准上以14.72%的 DER 居首，优于第二名19.3%；相比 Streaming Sortformer，在1.04秒音频缓冲下八个测试场景平均错误率降低41%，并支持0.32秒至30.4秒四档动态缓冲以平衡延迟与精度。模型可与 Parakeet 等语音识别系统配合，生成带匿名说话人标签的文本。在参与者更多、背景噪声大或混响严重时错误率可能上升。
AI推荐理由 输入提供了具体可核验的技术信息：NVIDIA 发布约1亿参数、开放权重的 Nemotron3Diarization 说话人分割聚类模型，支持最多8人同时说话，VoiceArena v1 基准 DER 14.72%，优于第二名19.3%，相比 Streaming Sortformer 在1.04秒缓冲下八个测试场景平均错误率降低41%，并提供0.32至30.4秒四档动态缓冲。这些是明确的模型能力与基准数据，对实时会议记录、客服和多说话人语音交互有实际价值。局限在于来源为 AIbase 转述而非 NVIDIA 官方原文，摘要未给出基准测试细节、许可条款和部署条件，且正文自述在人多、噪声大或混响严重时错误率会上升，因此不能视为已验证的全面突破。
72
正文
NVIDIA releases 1 billion parameter free model Nemotron3 with support for real-time voice separation of 8 people
AIbase基地
Published inAI News · 3 min read · Sep 28, 2026
4
On September 27, NVIDIA officially released the free artificial intelligence model Nemotron3Diarization with approximately 100 million parameters. This model focuses on the speech segmentation clustering (Diarization) task, and it has opened up weight data, allowing accurate identification of speakers at any moment in a conversation. It supports real-time and recorded audio processing for up to eight people speaking simultaneously.
In terms of technical breakthroughs and performance, Nemotron3Diarization topped the VoiceArena speech segmentation benchmark test (v1 version) with an error rate (DER) of 14.72%, significantly outperforming the second-ranked system (19.3%). Compared to its predecessor, Streaming Sortformer, the new model achieved an average error rate reduction of 41% across eight test scenarios using a 1.04-second audio buffer. To balance system latency and accuracy, the model supports four levels of dynamic audio buffer settings ranging from 0.32 seconds to 30.4 seconds.
In terms of functional applications, the new model can seamlessly collaborate with speech recognition systems such as Parakeet to automatically generate text with anonymous speaker tags (e.g., "speaker_2"). Although the error rate may increase when there are more participants, excessive background noise, or severe reverberation, its powerful underlying architecture can effectively address traditional challenges such as overlapping speech.
This release of a lightweight and free high-precision speech segmentation model by NVIDIA significantly lowers the technical barriers for complex speech analysis. This move not only provides a highly cost-effective underlying support for applications such as real-time meeting records, smart customer service, and multi-speaker voice interaction, but also indicates that the deployment of multi-speaker identification technology in edge devices and real-time commercial scenarios will accelerate further.
Nemotron3DiarizationAIneologismNVIDIAspeechsegmentationclustering
This article is from AIbase Daily
Scan to view
Welcome to the [AI Daily] column! This is your daily guide to exploring the world of artificial intelligence. Every day, we present you with hot topics in the AI field, focusing on developers, helping you understand technical trends, and learning about innovative AI product applications.
—— Created by the AIbase Daily Team
© Copyright AIbase Base 2024, Click to View Source -