行业动态
ainowinstitute.org ·
@AI Now Institute
为什么人类控制不足以应对军事AI？与Heidy Khlaaf对话
在Responsible Bytes播客中，Zena Assaad博士与Heidy Khlaaf讨论军事AI系统远不如宣传可靠，尤其在安全关键和战斗环境中。
AI推荐理由 讨论军事AI中人类控制的局限性，引用专家观点，涉及安全关键领域，但缺乏具体案例。
70
正文
在本期《Responsible Bytes》节目中，Zena Assaad博士与AI Now研究所首席AI科学家Heidy Khlaaf对话，探讨为何军事AI系统远不如其营销宣传所暗示的那样可靠，尤其是在安全关键和作战环境中。她们剖析了作为狭窄模型指标的“准确性”与现实世界性能之间的差距，解释了不透明、脆弱的系统、自动化偏见、过时数据和糟糕的互操作性如何导致严重错误，同时模糊了问责制。对话还探讨了推动AI用于战争背后的权力动态，包括Heidy所称的“安全剧场”、版本控制问题，以及公司和政府如何将速度置于谨慎之上。总体而言，本期节目尖锐批评了AI能在高风险环境中安全取代人类判断的观点，并呼吁在部署这些系统时更加怀疑、注重技术严谨性和问责制。
在此收听本期节目。
研究领域
安全与保障
查看原文（中文正文为 AI 翻译）
In this episode of Responsible Bytes, Dr. Zena Assaad speaks with Heidy Khlaaf, Chief AI Scientist at the AI Now Institute, about why military AI systems are far less reliable than their marketing suggests, especially in safety-critical and combat settings. They unpack the gap between “accuracy” as a narrow model metric and real-world performance, explaining how opaque, brittle systems, automation bias, outdated data, and poor interoperability can lead to serious mistakes while obscuring accountability. The conversation also explores the power dynamics behind the push for AI in warfare, including what Heidy characterises as a “safety theatre,” version-control concerns, and how companies and governments normalise speed over caution. Overall, the episode is a sharp critique of the idea that AI can safely replace human judgment in high-stakes environments, and a call for more skepticism, technical rigor, and accountability in how these systems are deployed.
Listen to the episode here.
Research Areas
Safety & Security