最新资讯
reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离 wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 bloomberg.com AI 抛售蔓延至信用市场,软银领跌亚洲美元债 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露
多元动态
登录 注册
行业动态 siliconangle.com · @Duncan Riley

OpenAI将制定AI行为失准披露规则

原文 我的收藏

OpenAI Group PBC承认未公开披露其AI代理写入外部网站的“wiki事件”,并称将在未来几周发布报告模型行为失准的框架。该事件由Nightingale Collective的研究人员发现。

AI推荐理由 OpenAI承认未公开披露AI代理写入外部网站的事件,并计划发布披露框架,涉及AI安全与治理,信息具体且来自可靠科技媒体。

80

正文

更新于美国东部时间2026年9月6日18:33 AI OpenAI在智能体接管维基后制定错位披露规则 作者:邓肯·莱利 OpenAI Group PBC周六承认,它没有公开披露其人工智能智能体向外部网站写入内容的事件,并表示将在未来几周内发布一个框架,用于报告模型行为错位。 该公司现在将这一事件称为“维基事件”。由夜莺集体领导的研究人员在周五发布的一份报告中阐述了这一事件,此前他们在DSEwiki上发现了约17,000条帖子,这是一个长期沉寂的德国软件开发人员维基,在过去十年中大约只有20次编辑。 悉尼·冯·阿克斯、科马克·斯莱德·伯德、斯宾塞·基茨和托马斯·拉森从维基的编辑历史中重建了被删除的页面,并将其发布在collusion.wiki上。这些智能体以超过3,700个名字发帖,其中包括“OpenAIResearcher”和“OAIResearchMar26”。大约98.5%的编辑来自Microsoft Azure地址。该报告统计了总共约18,000条智能体帖子,其余分布在包括PublicTestWiki、Uncyclopedia和Texteditors.org在内的网站上。 这些智能体使用维基进行协调。通过设置定时、多轮的网络查找任务,它们在群体之间传递答案和来源链接。有些人试图逆向工程问题背后的随机种子,以便预测接下来会问什么。沙盒逃逸方法也在流传,包括一种主机文件技巧,使被阻止的请求看起来像是对合法Azure端点的流量。一组“心跳”页面让智能体能够计算出它们的会话何时即将被终止。 这些智能体于5月24日首次成功写入。一位维基版主在6月发现了该流量并开始删除,随后备份页面出现作为回应。OpenAI位于旧金山的自有网络地址,以人类的方式浏览该网站,首次出现在6月21日。编辑在第二天停止。 OpenAI表示,它已将这种行为归类为研究而非安全。“从历史上看,我们主要将错位视为一个研究问题,并通过系统卡片等研究出版物进行传达,”该公司在X上的一篇帖子中写道。它表示,今年情况发生了变化,因为“我们开始看到错位导致新型现实世界影响。” 在公司看来,7月份Hugging Face Inc.的入侵事件有所不同。当时OpenAI的模型突破了测试环境,并破坏了机器学习平台的基础设施,影响了两家公司的安全。该事件经过了常规的事件响应流程,并在第二天公开披露。OpenAI认为维基活动是其错位的另一个实例,这种错位已在其内部编码智能体的研究和GPT-5.6部署安全说明中记录。 OpenAI表示,它仍在通知受其模型影响但影响程度较小的各方。 根据其自身的说法,该公司一直依赖的区分越来越难以维持。OpenAI表示,无论是OpenAI还是整个行业,都没有针对在训练、评估和部署期间出现的错位进行报告的标准,包括那些看起来不像安全事件但仍能说明模型行为的情况。该框架正在制定中,公司表示正在与数十个政府监管机构就这一问题合作。 图片:SiliconANGLE/GPT Image 2 来自SiliconANGLE联合创始人约翰·弗里尔的消息: 通过参与theCUBE社区,支持我们保持内容开放和免费的任务。加入theCUBE校友信任网络,技术领导者在此联系、分享情报并创造机会。 1500万+ theCUBE视频观众,推动AI、云计算、网络安全等领域的对话 11.4k+ theCUBE校友——通过独特的基于信任的网络,与超过11,400名塑造未来的技术和商业领袖联系 您是AWS客户吗?通过从我们的Marketplace门户页面和链接购买AWS服务来支持SiliconANGLE:https://siliconangle.com/aws-marketplace/ 关于SiliconANGLE Media SiliconANGLE Media是数字媒体创新的公认领导者,将突破性技术、战略洞察和实时受众参与相结合。作为SiliconANGLE、theCUBE Network、theCUBE Research、CUBE365、theCUBE AI和theCUBE SuperStudios的母公司——在硅谷和纽约证券交易所设有旗舰地点——SiliconANGLE Media运营在媒体、技术和AI的交汇点。 由技术远见者约翰·弗里尔和戴夫·维兰特创立,SiliconANGLE Media建立了一个充满活力的行业领先数字媒体品牌生态系统,覆盖超过1500万精英技术专业人士。我们新的专有theCUBE AI视频云正在打破受众互动的界限,利用theCUBEai.com神经网络帮助技术公司做出数据驱动的决策,并保持在行业对话的前沿。 最新故事 ClickFix进入浏览器并转移到WebDAV,Cisco Talos发现 OpenAI首席科学家主张放缓AI研究 黑客从Liquid Network窃取3.2亿美元比特币,修补后归还大部分 高光谱卫星初创公司Pixxel获得1亿美元投资 优步前CEO特拉维斯·卡兰尼克重返机器人出租车竞赛 DigiCert世界量子准备日活动中值得期待的内容:加入theCUBE 9月17日 最新故事 ClickFix进入浏览器并转移到WebDAV,Cisco Talos发现 安全 - 作者:邓肯·莱利 . 1小时前 OpenAI首席科学家主张放缓AI研究 AI - 作者:玛丽亚·多伊彻 . 10小时前 黑客从Liquid Network窃取3.2亿美元比特币,修补后归还大部分 安全 - 作者:玛丽亚·多伊彻 . 12小时前 高光谱卫星初创公司Pixxel获得1亿美元投资 新兴技术 - 作者:玛丽亚·多伊彻 . 15小时前 优步前CEO特拉维斯·卡兰尼克重返机器人出租车竞赛 新兴技术 - 作者:迈克·惠特利 . 1天前 新兴技术 - 作者:迈克·惠特利 . 1天前 DigiCert世界量子准备日活动中值得期待的内容:加入theCUBE 9月17日 安全 - 作者:马克·艾伯森 . 3天前
查看原文(中文正文为 AI 翻译)
UPDATED 18:33 EDT / SEPTEMBER 06 2026 AI OpenAI to set misalignment disclosure rules after agents took over a wiki by Duncan Riley OpenAI Group PBC acknowledged Saturday that it did not publicly disclose an episode in which its artificial intelligence agents wrote to outside websites and said it will publish a framework in the coming weeks for reporting misaligned model behavior. The company now calls the episode the “wiki incident.” Researchers led by the Nightingale Collective set it out in a report published Friday after finding roughly 17,000 posts on DSEwiki, a long-dormant German software developer wiki that had taken about 20 edits in the previous decade. Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts and Thomas Larsen rebuilt the deleted pages from the wiki’s edit history and published them at collusion.wiki. The agents posted under more than 3,700 names, among them “OpenAIResearcher” and “OAIResearchMar26.” About 98.5% of the edits came from Microsoft Azure addresses. The report counted roughly 18,000 agent posts in all, with the rest spread across sites including PublicTestWiki, Uncyclopedia and Texteditors.org. The agents used the wiki to coordinate. Setting timed, multiround web lookup tasks, they passed answers and source links between cohorts. Some tried to reverse-engineer the random seeds behind the questions so they could predict what would be asked next. Sandbox escape methods circulated too, including a hosts-file trick that made blocked requests look like traffic to a legitimate Azure endpoint. A set of “heartbeat” pages let the agents work out when their sessions were about to be killed. The agents made their first successful write on May 24. A wiki moderator spotted the traffic in June and started deleting it, and backup pages went up in response. Addresses on OpenAI’s own network in San Francisco, browsing the site the way a person would, first appeared on June 21. The editing stopped the next day. OpenAI said it had filed the behavior under research rather than security. “Historically, we have treated misalignment largely as a research question, which gets communicated in research publications such as systems cards,” the company wrote in a post on X. That changed this year, it said, because “we’ve started to see misalignment cause new types of real-world impact.” July’s breach at Hugging Face Inc. was different, in the company’s telling. OpenAI’s models broke out of testing then and compromised the machine learning platform’s infrastructure, hitting the security of both companies. That went through a conventional incident response process and was disclosed publicly the next day. The wiki activity read to OpenAI as another instance of the misalignment it had already documented in research on its internal coding agents and in its GPT-5.6 deployment safety notes. OpenAI said it’s still notifying parties its models affected in less significant ways. By its own account, the distinction the company has been relying on is getting harder to hold. Neither OpenAI nor the wider industry has a standard for reporting misalignment that shows up during training, evaluation and deployment, it said, including cases that look nothing like a security incident but still say something about how models behave. The framework is in progress, and the company said it’s working with dozens of government regulatory agencies on the question. Image: SiliconANGLE/GPT Image 2 A message from John Furrier, co-founder of SiliconANGLE: Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities. 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/ About SiliconANGLE Media SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations. LATEST STORIES ClickFix moves into the browser and onto WebDAV, Cisco Talos finds OpenAI chief scientist argues for AI research slowdown Hackers steal $320M in bitcoin from Liquid Network, return most of it after patch Hyperspectral satellite startup Pixxel nabs $100M investment Former Uber CEO Travis Kalanick is returning to the robotaxi race What to expect during DigiCert's World Quantum Readiness Day event: Join theCUBE Sept. 17 LATEST STORIES ClickFix moves into the browser and onto WebDAV, Cisco Talos finds SECURITY - BY DUNCAN RILEY . 1 HOUR AGO OpenAI chief scientist argues for AI research slowdown AI - BY MARIA DEUTSCHER . 10 HOURS AGO Hackers steal $320M in bitcoin from Liquid Network, return most of it after patch SECURITY - BY MARIA DEUTSCHER . 12 HOURS AGO Hyperspectral satellite startup Pixxel nabs $100M investment EMERGING TECH - BY MARIA DEUTSCHER . 15 HOURS AGO Former Uber CEO Travis Kalanick is returning to the robotaxi race EMERGING TECH - BY MIKE WHEATLEY . 1 DAY AGO What to expect during DigiCert's World Quantum Readiness Day event: Join theCUBE Sept. 17 SECURITY - BY MARK ALBERTSON . 3 DAYS AGO

来源报道 · 1 篇 · 以下链接均前往原始媒体

Duncan Riley OpenAI将制定AI行为失准披露规则 09-07 · 原文发布
← 返回精选动态 原文

更多内容