最新资讯
bloomberg.com Nvidia 加强东南亚芯片追踪以打击走私 thestack.technology 模型路由需求升温,Agent Router 推出开源替代方案 unite.ai Cashfree 为 AI Agent 的托管结账加入 WebMCP 工具 dev.to 我们在 DolphinBench 上测试记忆检索:纯关键词搜索暴露了自身回归 dev.to 别再把 Agent 写成 while 循环,把它建模为状态机 analyticsindiamag.com 小语言模型可能重塑企业 AI 部署方式 bloomberg.com Rightmove 与 Scout24 借 AI 产品应对低迷房市并上调展望 stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准
多元动态
登录 注册
大模型 techspot.com · @Kishalaya Kundu

Anthropic 称已阻止国家背景行为者利用 Claude 进行生物武器研究

原文 我的收藏

Anthropic 披露至少五起案例,疑似国家背景行为者绕过专门管控,试图访问 Claude 中有关禽流感等传染病以及肉毒杆菌毒素等致命毒物的知识。该报道为二手转述,未附官方报告全文。

AI推荐理由 Anthropic 披露至少五起疑似国家背景行为者绕过管控、试图用 Claude 获取传染病与毒素知识用于生物武器研究的案例,涉及 AI 安全与滥用防护,具产业与政策意义;但为二手转述,缺少官方报告原文与完整细节。

66

正文

Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust. What we know so far: Anthropic, the San Francisco-based AI company led by Dario Amodei, claims to have identified possible attempts by suspected state-sponsored researchers to exploit its Claude AI model to develop biological weapons. The company added that the users were blocked after repeated attempts triggered Claude's built-in safety protocols. Anthropic recently detailed at least five cases where suspected rogue actors "circumvented controls" specifically designed to prevent users in certain parts of the world from accessing Claude's extensive knowledge base regarding infectious diseases, such as bird flu, and lethal venoms and toxins, like botulinum toxin. However, the total number of attempts is much larger, with the company claiming to have identified about 35 distinct efforts between November 2025 and September 2026 by possible state-funded bioweapons developers to "obfuscate the purpose of their research to evade our safeguards." One of the suspected cases involved gain-of-function research into the transmission and immune evasion of the chikungunya virus. Another account was flagged for researching how the bird flu virus can be adapted to cause severe illness in mammals. Researchers were also banned for queries about orthopoxviruses – a genus of DNA viruses that includes variola, which causes smallpox, and mpox. Anthropic acknowledged that it is difficult to determine whether research on toxins, poisons, and related substances is intended to aid the manufacture of bioweapons or to develop antidotes, vaccines, and other medical or therapeutic solutions. However, what caused the system to flag the aforementioned attempts was the use of various anonymizing techniques to evade Anthropic's regional blocking. In the aftermath of the bioweapons scare, Anthropic says it has upgraded its safety protocols to prevent threat actors from exploiting its AI models for nefarious purposes. "Out of an abundance of caution, we have launched recent models (most notably Claude Fable 5) with stronger safeguards that restrict access to a wide range of dual-use biological research queries," the company stated. // Related Stories Anthropic researcher resigns, warns the AI race could end in human extinction OpenAI faces Senate probe over Hugging Face breach as more rogue AI activity is uncovered Anthropic did not identify the regions from which these queries are believed to have originated, but the company is widely known to block users in China, Russia, Iran, North Korea, and several other countries from accessing Claude. However, it says it blocked all suspect accounts by May 2026 for violating its Supported Regions Policy. According to Anthropic, misusing AI to create bioweapons is one of the "most serious risks" facing AI models. The company added that it incorporated the guardrails precisely to avoid situations like these, in which rogue nation-states could exploit AI to prepare deadly bioweapons and use them to wage biological warfare against their own people or Western democracies. Share this article: See more TechSpot in Google Add us as a preferred source and our reporting shows up first when you search. Add TechSpot Featured on TechSpot These AI agents hijacked a wiki to discuss how to escape their sandbox Florida police used a fake Flock camera in a sting, charged a man for destroying it

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容