大模型
slashdot.org ·
Anthropic 称已阻止多起可能用于生物武器研发的 Claude 滥用行为
Anthropic 发布报告称，今年已阻断数起科学家使用 Claude 进行可能有助于生物武器开发的生物研究案例，并承认因合法生物研究与危险病原体工程界限模糊而选择从严处理。报告还记录了俄罗斯官媒用 Claude 生成伪装成独立报道的摩尔多瓦选举虚假信息，以及在中国（3 起）、俄罗斯（2 起）和也门（1 起，疑似伊朗支持的胡塞武装）使用 Claude 开发枪械、导弹、武装无人机和炸弹等常规武器软件的新滥用类型。
AI推荐理由 Anthropic 发布报告披露过去八个月 Claude 被滥用的具体案例，包括疑似国家背景行为者用于生物研究、俄罗斯官媒生成虚假报道、以及中国、俄罗斯、也门等地用 Claude 开发常规武器软件；信息密度高且含具体案例数量，但内容为转述 Anthropic 自述报告，缺乏独立验证，且生物武器部分 Anthropic 自认无法判定用途，需保留不确定性。
78
正文
185594528
story
Anthropic says it has disrupted several cases this year in which scientists used Claude for biological research that could potentially aid bioweapons development. "In a report describing misuses of its A.I. models, Anthropic said it could not determine whether the research served a legitimate or nefarious purpose because valid biological inquiry -- the kind that can lead to breakthroughs like vaccines -- can also help engineer dangerous pathogens," reports The New York Times. "In the face of that uncertainty, Anthropic said it erred on the side of caution because the consequences of missing malicious activity could be severe." From the report: The potential for cutting-edge A.I. models to facilitate the development of known or entirely new biological pathogens is among the gravest concerns experts have about a technology that is developing so rapidly that even its leading architects doubt whether humans will be able to fully control it. Andrew Weber, a senior fellow on the Council on Strategic Risks who reviewed Anthropic's report before its release, said the findings were "chilling examples of state-sponsored biological weapons developers tapping into the rapidly advancing capabilities" of leading A.I. models.
The lengthy report Anthropic published on Thursday cataloged a litany of misuses of its A.I. models, including the chatbot Claude, over the past eight months. Some examples were similar to past disclosures from Anthropic and other A.I. labs, including suspected Chinese and Iranian government-linked actors targeting dissident and diaspora communities for surveillance.
The report also highlighted cases of Russian state media using Claude to generate online propaganda masquerading as independent reporting, including fabricated claims about an election in Moldova. Anthropic documented another genre of abuse it said was new: attempts to use Claude to develop software for conventional weapons design and development, including firearms, missiles, armed drones and bombs. It detailed three cases in China, two in Russia and one in Yemen. The report does not identify by name which parties were involved in the Yemeni case, but the context makes clear that it is referring to the Iran-backed Houthi militia.