算力商业
slashdot.org ·
Anthropic CEO Dario Amodei 呼吁放缓 AI 开发
Anthropic CEO Dario Amodei 在周六发表的 3800 字文章中呼吁全球放缓人工智能开发速度，称近几个月他确信需要更多审慎，不仅要投资风险预防，还要控制能力提升的节奏。他建议各 AI 实验室接受第三方“嵌入式评估员”的安全审查，并推动民主国家协调制定安全标准，甚至需要与包括威权国家在内的全球力量合作。文章发表前数日，一名 Anthropic 员工因技术安全担忧离职；Bloomberg 也报道 Sam Altman 向 OpenAI 员工表示公司愿意放缓 AI 开发。Amodei 强调 AI 仍可能带来治愈疾病和加速经济增长等巨大益处，但风险过大必须极度谨慎。
AI推荐理由 Anthropic CEO Dario Amodei 在 3800 字文章中公开呼吁全球放缓 AI 开发节奏，并提出第三方嵌入式评估员、民主国家协调安全标准等具体建议；文中还提到一名员工因安全担忧离职，以及 Bloomberg 报道 Sam Altman 向 OpenAI 员工表示愿意放缓开发。这是来自头部 AI 实验室高层的政策立场表态，对 AI 安全治理和产业节奏有参考价值，但属于观点性文章而非可验证的技术突破，且转述自 NYT，信息密度中等。
72
正文
185623986
story
An anonymous reader quotes a report from The New York Times: The chief executive of Anthropic called for a global slowdown of artificial intelligence development in a 3,800-word essay on Saturday, just days after one of the company's employees quit over concerns about the safety of the technology. Dario Amodei, who co-founded Anthropic to focus on securely and carefully building A.I., wrote that while he believed the technology could bring many benefits, it was advancing at too quick a pace for researchers to continue safely.
"Over the last few months, I have become convinced that fully addressing the risks requires even more prudence -- not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up," Mr. Amodei said. "We must slow the pace at which we improve the capabilities of A.I. models. Progress will still seem fast, and we must make wise use of the time we gain." [...] "Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all," Mr. Amodei said.
[...] In his essay on Saturday, Mr. Amodei suggested actions that the industry might take to slow down the pace of development.
Mr. Amodei said all A.I. labs could agree to third-party technology assessments from "embedded evaluators," or outside specialists who can verify best safety practices across companies. He also suggested that countries with democratic governance systems coordinate to create safety standards, which could take the form of regulatory action. He added that it would probably require a global effort working with other nations, including authoritarian ones, to properly coordinate a slowdown.
Mr. Amodei stressed in his essay that he still finds A.I. capable of bringing "incredible benefits" to humanity, including potentially curing diseases and accelerating economic growth. But even so, Mr. Amodei said the risks of A.I. were too great to not proceed with extreme caution. "The measures I propose to advance the frontier at a safe pace will not be easy," Mr. Amodei wrote. "But I believe we owe it to humanity to try." Amodei's essay comes just hours after Bloomberg reported that Sam Altman told OpenAI employees the company is open to slowing the pace of AI development amid similar concerns.