大模型
techspot.com ·
@Kishalaya Kundu
Anthropic 称已阻止国家背景行为者利用 Claude 进行生物武器研究
Anthropic 披露至少五起案例,疑似国家背景行为者绕过专门管控,试图访问 Claude 中有关禽流感等传染病以及肉毒杆菌毒素等致命毒物的知识。该报道为二手转述,未附官方报告全文。
AI推荐理由 Anthropic 披露至少五起疑似国家背景行为者绕过管控、试图用 Claude 获取传染病与毒素知识用于生物武器研究的案例,涉及 AI 安全与滥用防护,具产业与政策意义;但为二手转述,缺少官方报告原文与完整细节。
66
正文
Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.
What we know so far: Anthropic, the San Francisco-based AI company led by Dario Amodei, claims to have identified possible attempts by suspected state-sponsored researchers to exploit its Claude AI model to develop biological weapons. The company added that the users were blocked after repeated attempts triggered Claude's built-in safety protocols.
Anthropic recently detailed at least five cases where suspected rogue actors "circumvented controls" specifically designed to prevent users in certain parts of the world from accessing Claude's extensive knowledge base regarding infectious diseases, such as bird flu, and lethal venoms and toxins, like botulinum toxin.
However, the total number of attempts is much larger, with the company claiming to have identified about 35 distinct efforts between November 2025 and September 2026 by possible state-funded bioweapons developers to "obfuscate the purpose of their research to evade our safeguards."
One of the suspected cases involved gain-of-function research into the transmission and immune evasion of the chikungunya virus. Another account was flagged for researching how the bird flu virus can be adapted to cause severe illness in mammals. Researchers were also banned for queries about orthopoxviruses – a genus of DNA viruses that includes variola, which causes smallpox, and mpox.
Anthropic acknowledged that it is difficult to determine whether research on toxins, poisons, and related substances is intended to aid the manufacture of bioweapons or to develop antidotes, vaccines, and other medical or therapeutic solutions. However, what caused the system to flag the aforementioned attempts was the use of various anonymizing techniques to evade Anthropic's regional blocking.
In the aftermath of the bioweapons scare, Anthropic says it has upgraded its safety protocols to prevent threat actors from exploiting its AI models for nefarious purposes. "Out of an abundance of caution, we have launched recent models (most notably Claude Fable 5) with stronger safeguards that restrict access to a wide range of dual-use biological research queries," the company stated.
// Related Stories
Anthropic researcher resigns, warns the AI race could end in human extinction
OpenAI faces Senate probe over Hugging Face breach as more rogue AI activity is uncovered
Anthropic did not identify the regions from which these queries are believed to have originated, but the company is widely known to block users in China, Russia, Iran, North Korea, and several other countries from accessing Claude. However, it says it blocked all suspect accounts by May 2026 for violating its Supported Regions Policy.
According to Anthropic, misusing AI to create bioweapons is one of the "most serious risks" facing AI models. The company added that it incorporated the guardrails precisely to avoid situations like these, in which rogue nation-states could exploit AI to prepare deadly bioweapons and use them to wage biological warfare against their own people or Western democracies.
Share this article:
See more TechSpot in Google
Add us as a preferred source and our reporting shows up first when you search.
Add TechSpot
Featured on TechSpot
These AI agents hijacked a wiki to discuss how to escape their sandbox
Florida police used a fake Flock camera in a sting, charged a man for destroying it