最新资讯
dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围 dev.to 银行 77 意图分类最便宜 LLM:GPT-6.1 Terra 每次成功任务 $0.000727 theinformation.com Chesky的副业:Airbnb向CEO新设AI实验室出售IP theverge.com OpenAI 宣布数据中心项目不再与公职人员签署保密协议 dev.to NVIDIA 发布四个开放 Cosmos 3 仿真模型 dev.to 真实 MCP 客户端击穿我们服务器的五种方式 theverge.com Airbnb 正在开发 AI 旅行 agent,计划 2027 年上半年推出 wechat 这可能是美国AI最魔幻的一天。 nytimes.com 美众议院共和党领袖要求 Nvidia 黄仁勋闭门简报 pub.towardsai.net 忘掉我:为记忆而设计的系统中的删除难题 marktechpost.com Google 发布 Gemini Omni 1.2 Flash:15 秒视频,每秒 0.07 美元
多元动态
登录 注册
行业动态 siliconangle.com · @Maria Deutscher

Anthropic 研究员辞职引发 AI 安全广泛讨论

原文 我的收藏

Anthropic PBC 预训练团队成员 Jacob Coxon 宣布辞职,理由是对 AI 实验室“拿我们的生命赌博”的担忧。他在 X 上发布一系列帖子公布该决定,获得数百万次浏览,并引发关于 AI 安全的广泛讨论。摘要未提供公司回应或更多可验证细节。

AI推荐理由 报道 Anthropic 预训练团队成员 Jacob Coxon 因担忧 AI 实验室“拿我们的生命赌博”而辞职,并通过 X 帖子引发广泛讨论。事件本身是 AI 安全议题的具体新信息,但摘要仅转述其辞职动机,未提供可独立验证的细节或公司回应,且传播热度来自 X 帖子,不能替代事实依据。

60

正文

UPDATED 16:24 EDT / SEPTEMBER 09 2026 AI Anthropic researcher’s resignation sparks broad AI safety discussion by Maria Deutscher An Anthropic PBC researcher has resigned over concerns that artificial intelligence labs are “gambling with our lives.” Jacob Coxon was part of the company’s AI pretraining team until today. He announced his resignation in a series of X posts that has been viewed millions of times. Coxon wrote that his decision was motivated by concerns over recursive self-improvement, or RSI. That’s a term for a hypothetical future AI with the ability to automatically improve its own capabilities. “These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources,” Coxon wrote. “The people building AI earnestly believe that it could kill us all by the end of the decade.” Evan Hubinger, Anthropic’s alignment science lead, reaffirmed the latter point in an X post. “Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,” he wrote. No AI lab has announced a working implementation of RSI yet. However, Anthropic and OpenAI Group PBC are already using AI to automate model development tasks. In April, the former company revealed that Claude had completed an AI research experiment with minimal human input. The project focused on mitigating the risks posed by large language models. Coxon’s resignation drew responses from not only Hubinger but also hundreds of other industry observers. Many expressed alarm about the concerns he raised, while others voiced doubts. Some commentators pointed out that Coxon’s resignation could have implications for Anthropic’s upcoming initial public offering. “If Anthropic is intellectually honest; then this risk better appear on their S-1,” tweeted AI investor and researcher Azeem Azhar. “This will be the best test on whether they do seriously believe that.” A number of lawmakers also reacted to the news. Vermont Senator Bernie Sanders wrote on X that “I will soon be introducing legislation to ban superintelligence and pause AI development.” Massachusetts representative Lori Trahan, who recently introduced a bill designed to regulate advanced AI models, stated that “it’s past time for Congress to get off the sidelines and do its job.” Coxon’s resignation comes on the heels of several landmark advances in AI research. On Tuesday, OpenAI revealed that an unreleased model had solved one of the most difficult open problems in mathematics. The algorithm found a fault in a set of equations that scientists use to study the motion of fluids. The Navier-Stokes equations, as they’re called, have applications in fields ranging from healthcare to auto design. Last week, Anthropic used Claude to develop a computer-verifiable version of an important mathematical proof. The AI created it in 11 days instead of the years that the task was expected to take. Coxon joins a growing number of AI researchers who have expressed concerns about the rapid advance of frontier models. On Sunday, OpenAI Chief Scientist Jakub Pachocki urged the tech industry to slow down AI development. In July, a group of researchers signed an open letter that warned about the risks of self-improving frontier models. Image: Anthropic A message from John Furrier, co-founder of SiliconANGLE: Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities. 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/ About SiliconANGLE Media SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations. LATEST STORIES Certinia launches new System of Action as the foundation of autonomous service operations Sales automation startup Clay boosts valuation to $7.1B in $115M funding round AI-native CRM startup Lightfield raises $47M to build an AI agent-ready replacement for Salesforce General Robotics' GRID platform engineers itself, cutting robot setup to hours Harvey raises $550M more to develop AI tools for legal teams Cymphony launches with $30M to track what AI agents can reach LATEST STORIES Certinia launches new System of Action as the foundation of autonomous service operations AI - BY MIKE WHEATLEY . 7 HOURS AGO Sales automation startup Clay boosts valuation to $7.1B in $115M funding round CLOUD - BY MARIA DEUTSCHER . 10 HOURS AGO AI-native CRM startup Lightfield raises $47M to build an AI agent-ready replacement for Salesforce AI - BY MIKE WHEATLEY . 10 HOURS AGO General Robotics' GRID platform engineers itself, cutting robot setup to hours EMERGING TECH - BY DUNCAN RILEY . 11 HOURS AGO Harvey raises $550M more to develop AI tools for legal teams AI - BY MARIA DEUTSCHER . 12 HOURS AGO Cymphony launches with $30M to track what AI agents can reach SECURITY - BY DUNCAN RILEY . 12 HOURS AGO

来源报道 · 1 篇 · 以下链接均前往原始媒体

Maria Deutscher Anthropic 研究员辞职引发 AI 安全广泛讨论 09-10 · 原文发布
← 返回精选动态 原文

更多内容