最新资讯
www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离 wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航
多元动态
登录 注册
论文研究 www.aibase.com ·

研究称AI辅助下人类决策出现悖论:信心上升而准确率下降

原文 我的收藏

一项涉及3132名参与者、五项实验的研究显示,引入大语言模型建议后,受试者对高冷门问题的弃答率从36%–44%降至3%–6%,答题信心从29.6分升至75.9分,但实际准确率从27.5%降至9.2%。即使模型给出错误建议,人们也倾向接受并产生过度自信。设置答对奖励、答错扣分等经济激励可部分减少求助,但未能根本扭转信任错位;在模拟搜索引擎与写作助手自动展示AI答案的场景下,暂停判断的比例仍从39%降至7%。研究者将其归因于对AI流畅表达的盲目信任。该结论来自二手转述,论文出处与模型版本信息未在输入中给出,需进一步核实。

AI推荐理由 该文转述一项涉及3132名参与者、五项实验的研究,给出具体量化结果:无AI辅助时36%–44%的题目选择不作答,获得AI建议后降至3%–6%;信心从29.6分升至75.9分,而准确率从27.5%降至9.2%;经济激励下暂停判断比例从39%降至7%。这些数据对AI辅助决策的人机交互设计有直接参考价值。局限在于:来源为AIbase的二手转述,未提供论文标题、作者、发表渠道或链接,无法核实实验设计与统计口径;文中提及的GPT-5.5、Claude4.6Sonnet、Gemini3.5Flash、Step3.5Flash等模型名称无法从输入中确认其真实性与版本对应关系,需保留不确定性。

72

正文

Confidence Soars but Accuracy Plummets? Latest Study Reveals the Paradox of Human Decision-Making with AI Assistance AIbase基地 Published inAI News · 4 min read · Sep 28, 2026 4 The latest five experiments involving 3,132 participants study show that introducing AI large language models (such as GPT-5.5, Claude4.6Sonnet, and Gemini3.5Flash) is significantly weakening human ability to suspend judgment, making people almost completely lose the willingness to admit "I don't know." The research team specifically selected highly obscure questions that are prone to model hallucinations for testing. The results showed that in the control group without AI assistance, participants chose not to answer 36% to 44% of the questions; however, after obtaining AI suggestions, this non-response rate dropped sharply to 3% to 6%. More paradoxically, participants' confidence in answering questions increased from 29.6 points (out of 100) to 75.9 points with AI assistance, but their actual accuracy rate dropped dramatically from 27.5% to 9.2%, indicating that even when faced with incorrect suggestions from models like Step3.5Flash, people tend to blindly accept them and develop excessive confidence. Introducing economic incentive mechanisms such as rewards for correct answers and deductions for incorrect ones can reduce the frequency of people seeking AI help to some extent, but it has not fundamentally reversed this trust misalignment. More concerning for the industry is that when the test simulated the current norm of search engines and writing assistants by automatically displaying AI-generated answers to users, even under economic incentives, the proportion of participants suspending judgment dropped from 39% to 7%. Researchers attribute this phenomenon to a new trend of blind trust, where humans are easily persuaded by AI's fluent expressions, thus breaking the traditional habit of retaining some independent judgment in the process of seeking help. Combined with previous findings from Microsoft and related academic institutions regarding AI's impact on human critical thinking, over-reliance on AI is leading people to outsource cognitive tasks excessively. As generative AI becomes seamlessly integrated into various digital tools, how to improve the accuracy of models while designing appropriate human-computer interaction mechanisms to maintain human awareness of their own knowledge boundaries will become an important issue in the next phase of AI application. AILargeLanguageModelGPT-5.5Claude4.6SonnetGemini3.5Flash This article is from AIbase Daily Scan to view Welcome to the [AI Daily] column! This is your daily guide to exploring the world of artificial intelligence. Every day, we present you with hot topics in the AI field, focusing on developers, helping you understand technical trends, and learning about innovative AI product applications. —— Created by the AIbase Daily Team © Copyright AIbase Base 2024, Click to View Source -

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容