最新资讯
dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航 dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围
多元动态
登录 注册
行业动态 techxplore.com ·

AI研究员离开Anthropic,指责公司“拿我们的生命赌博”

原文 我的收藏

研究员Jacob Coxon在离开OpenAI后加入Anthropic,现决定离开AI行业,指责两家公司竞相开发自我改进的AI模型,不顾风险。Anthropic安全主管Evan Hubinger在X上回应,称AI可能杀死所有人的风险超过10%,并承认公司尚无确保超级智能服从的计划。

AI推荐理由 来自TechXplore,经事实核查,引用研究员和Anthropic安全主管的公开言论,信息具体,但属于观点性内容,非技术突破。对AI安全讨论有参考价值,但兴趣度中等。

75

正文

September 9, 2026 'They're playing with our lives': AI researcher quits Anthropic edited by Andrew Zinin Andrew Zinin Chief Editor Meet our editorial team Behind our editorial process Editors' notes This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility: fact-checked reputable news agency proofread The GIST Add as preferred source Jacob Coxon left the AI industry after working on pretraining AI models at Anthropic. An artificial intelligence researcher who left OpenAI to join Anthropic has decided to leave the industry, accusing both U.S. companies of "playing with our lives" in the race to develop AI models capable of self-improvement. Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approach. Pretraining is the stage where AI models absorb vast quantities of data. "Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives," Coxon said on Tuesday. "The people building AI earnestly believe that it could kill us all by the end of the decade," he said in a post on X. "This is not a marketing stunt," he added. Superintelligence is the theoretical point at which AI's capabilities exceed human intelligence. Anthropic safety executive Evan Hubinger backed up Coxon on X. "We really do earnestly believe AI could kill all humans!" he said, adding that he estimated that risk at more than 10% over the next decade. Hubinger said Anthropic is "trying its best," but does not yet have a plan to ensure an AI system that surpasses human capabilities would obey its creators. He said there was a "low" risk of that happening with current models. Coxon's resignation comes as Anthropic prepares for its market debut, following a summer marked by unauthorized hacks carried out by AI tools during testing. The two companies did not immediately respond to AFP requests for comment. AI leaders say so-called "recursive self-improvement," a stage where AI systems could essentially design and train the next generation of AI with little human involvement, is drawing near. Coxon considers Anthropic's efforts genuine but said he believes no company can responsibly develop an AI that surpasses humans without government intervention or a coordinated slowdown. "At Anthropic, the stakes are well-understood, but they are locked in a race to get there first—they believe no one else will act responsibly, so they must do it themselves, despite the risk," he said. In February, Anthropic removed a pledge from its safety charter to halt the development of its models if it failed to control their risks. It argued that if it unilaterally paused its work, its less cautious rivals would dominate the industry, making it less safe overall. At the end of July, more than 1,000 tech industry employees, including Anthropic CEO Dario Amodei, called on Washington to support a coordinated slowdown in the development of the most advanced AI systems. OpenAI halted training of its latest models for two weeks in August before resuming it under tighter controls. On Sunday, OpenAI chief scientist Jakub Pachocki called for "extreme caution." "International coordination on future AI development needs to become a top priority for governments around the world," he said in a blog post. AI models are not regulated by federal law in the United States. In September, Sen. Bernie Sanders and Democratic Rep. Greg Casar introduced a bill seeking to suspend AI development until a federal regulator is created. Key concepts AI governanceGenerative AI ethics Who's behind this story? Andrew Zinin Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile → © 2026 AFP Citation: 'They're playing with our lives': AI researcher quits Anthropic (2026, September 9) retrieved 9 September 2026 from https://techxplore.com/news/2026-09-theyre-playing-ai-anthropic.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only. Anthropic calls for pause of global AI development Jun 5, 2026 Anthropic urges industry coordination to allow for a 'pause' in AI development if risks grow Jun 5, 2026 AI industry slowdown may be needed after security scare, leaders warn Jul 29, 2026 Anthropic's models gained unauthorized 'real-world' access during testing Jul 31, 2026 US order cutting access to Anthropic's AI models sparks criticism Jun 15, 2026 Has AI become too powerful to control? Jul 24, 2026 AI controller translates VR, video and language commands into humanoid robot actions 33 minutes ago Built-in quantum sensor detects bending stress in microscopic devices 1 hour ago Bringing classical LDPC code design theory to quantum computers 1 hour ago Meta launches personal AI agent, Muse, emphasizes safety and privacy 6 hours ago Memristor chip breaks the capacity limit of brain-inspired associative memory 18 hours ago Invention may bring smart bionic eye into sight 18 hours ago

来源报道 · 1 篇 · 以下链接均前往原始媒体

rss::News on AI/ML - TechXplore AI研究员离开Anthropic,指责公司“拿我们的生命赌博” 09-09 · 原文发布
← 返回精选动态 原文

更多内容