最新资讯
reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离 wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 bloomberg.com AI 抛售蔓延至信用市场,软银领跌亚洲美元债 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露
多元动态
登录 注册
大模型 x.com · @OpenAIDevs

GPT-Live-1 在 Tau3 语音代理客户支持任务中首次尝试完成率 83.6%

原文 我的收藏

OpenAI 开发者账号称,Tau3 测试语音代理在航空、零售和电信场景完成客户支持任务的能力;与中等推理努力的 GPT-6 Astra 配对时,GPT-Live-1 首次尝试完成 83.6% 的任务,而 GPT-Realtime-2.1 为 45.7%,TauBanking 得分未在片段中给出。

AI推荐理由 给出语音代理在 Tau3 客户支持任务上的具体完成率对比(GPT-Live-1 配 GPT-6 Astra 为 83.6%,GPT-Realtime-2.1 为 45.7%),数据点明确且与语音 Agent 落地相关;但正文截断、TauBanking 结果缺失,且未提供完整评测方法。

65

正文

For the GPT-Live-1's intelligence, Tau3 tests whether a voice agent can actually complete customer-support tasks across airline, retail, and telecom scenarios. Paired with GPT-6 Astra at medium reasoning effort, GPT-Live-1 completed 83.6% of tasks on the first attempt, compared with 45.7% for GPT-Realtime-2.1. The same pairing scored 38.1% on TauBanking, where agents need to find information in banking documents and apply it while using tools to resolve customer requests. Of course, people chatting with our builds don’t talk in perfectly timed turns. They pause to think, interrupt with another question, or say “mm-hmm” without expecting you to stop: • GPT-Live-1 scored 97.3% on Artificial Analysis’s Conversational Dynamics benchmark, which evaluates when to wait, take a turn, respond to an interruption, or keep speaking through a short acknowledgment. • On Full Duplex Bench v1.5, it scored 80.1% on interactivity across overlapping speech, background voices, side conversations, and interruptions. • In Full Duplex Bench v1, it began responding 0.798 seconds after the user’s turn ended, compared with 1.41 seconds for GPT-Realtime-2.1. That measures the wait before the reply starts, not how quickly the model speaks. Getting the task right also means following a request when someone pauses, hesitates, or corrects themselves. With a backend model handling tool calls, the GPT-Live-1 setup achieved these results on Full Duplex Bench v3: • 87% tool-calling success for completing the correct sequence of tool calls. • 90% on the separate response-quality evaluation. Read more in the launch blog: openai.com/index/introduc…

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容