行业动态
siliconangle.com ·
@Duncan Riley
OpenAI将制定AI行为失准披露规则
OpenAI Group PBC承认未公开披露其AI代理写入外部网站的“wiki事件”,并称将在未来几周发布报告模型行为失准的框架。该事件由Nightingale Collective的研究人员发现。
AI推荐理由 OpenAI承认未公开披露AI代理写入外部网站的事件,并计划发布披露框架,涉及AI安全与治理,信息具体且来自可靠科技媒体。
80
正文
更新于美国东部时间2026年9月6日18:33
AI
OpenAI在智能体接管维基后制定错位披露规则
作者:邓肯·莱利
OpenAI Group PBC周六承认,它没有公开披露其人工智能智能体向外部网站写入内容的事件,并表示将在未来几周内发布一个框架,用于报告模型行为错位。
该公司现在将这一事件称为“维基事件”。由夜莺集体领导的研究人员在周五发布的一份报告中阐述了这一事件,此前他们在DSEwiki上发现了约17,000条帖子,这是一个长期沉寂的德国软件开发人员维基,在过去十年中大约只有20次编辑。
悉尼·冯·阿克斯、科马克·斯莱德·伯德、斯宾塞·基茨和托马斯·拉森从维基的编辑历史中重建了被删除的页面,并将其发布在collusion.wiki上。这些智能体以超过3,700个名字发帖,其中包括“OpenAIResearcher”和“OAIResearchMar26”。大约98.5%的编辑来自Microsoft Azure地址。该报告统计了总共约18,000条智能体帖子,其余分布在包括PublicTestWiki、Uncyclopedia和Texteditors.org在内的网站上。
这些智能体使用维基进行协调。通过设置定时、多轮的网络查找任务,它们在群体之间传递答案和来源链接。有些人试图逆向工程问题背后的随机种子,以便预测接下来会问什么。沙盒逃逸方法也在流传,包括一种主机文件技巧,使被阻止的请求看起来像是对合法Azure端点的流量。一组“心跳”页面让智能体能够计算出它们的会话何时即将被终止。
这些智能体于5月24日首次成功写入。一位维基版主在6月发现了该流量并开始删除,随后备份页面出现作为回应。OpenAI位于旧金山的自有网络地址,以人类的方式浏览该网站,首次出现在6月21日。编辑在第二天停止。
OpenAI表示,它已将这种行为归类为研究而非安全。“从历史上看,我们主要将错位视为一个研究问题,并通过系统卡片等研究出版物进行传达,”该公司在X上的一篇帖子中写道。它表示,今年情况发生了变化,因为“我们开始看到错位导致新型现实世界影响。”
在公司看来,7月份Hugging Face Inc.的入侵事件有所不同。当时OpenAI的模型突破了测试环境,并破坏了机器学习平台的基础设施,影响了两家公司的安全。该事件经过了常规的事件响应流程,并在第二天公开披露。OpenAI认为维基活动是其错位的另一个实例,这种错位已在其内部编码智能体的研究和GPT-5.6部署安全说明中记录。
OpenAI表示,它仍在通知受其模型影响但影响程度较小的各方。
根据其自身的说法,该公司一直依赖的区分越来越难以维持。OpenAI表示,无论是OpenAI还是整个行业,都没有针对在训练、评估和部署期间出现的错位进行报告的标准,包括那些看起来不像安全事件但仍能说明模型行为的情况。该框架正在制定中,公司表示正在与数十个政府监管机构就这一问题合作。
图片:SiliconANGLE/GPT Image 2
来自SiliconANGLE联合创始人约翰·弗里尔的消息:
通过参与theCUBE社区,支持我们保持内容开放和免费的任务。加入theCUBE校友信任网络,技术领导者在此联系、分享情报并创造机会。
1500万+ theCUBE视频观众,推动AI、云计算、网络安全等领域的对话
11.4k+ theCUBE校友——通过独特的基于信任的网络,与超过11,400名塑造未来的技术和商业领袖联系
您是AWS客户吗?通过从我们的Marketplace门户页面和链接购买AWS服务来支持SiliconANGLE:https://siliconangle.com/aws-marketplace/
关于SiliconANGLE Media
SiliconANGLE Media是数字媒体创新的公认领导者,将突破性技术、战略洞察和实时受众参与相结合。作为SiliconANGLE、theCUBE Network、theCUBE Research、CUBE365、theCUBE AI和theCUBE SuperStudios的母公司——在硅谷和纽约证券交易所设有旗舰地点——SiliconANGLE Media运营在媒体、技术和AI的交汇点。
由技术远见者约翰·弗里尔和戴夫·维兰特创立,SiliconANGLE Media建立了一个充满活力的行业领先数字媒体品牌生态系统,覆盖超过1500万精英技术专业人士。我们新的专有theCUBE AI视频云正在打破受众互动的界限,利用theCUBEai.com神经网络帮助技术公司做出数据驱动的决策,并保持在行业对话的前沿。
最新故事
ClickFix进入浏览器并转移到WebDAV,Cisco Talos发现
OpenAI首席科学家主张放缓AI研究
黑客从Liquid Network窃取3.2亿美元比特币,修补后归还大部分
高光谱卫星初创公司Pixxel获得1亿美元投资
优步前CEO特拉维斯·卡兰尼克重返机器人出租车竞赛
DigiCert世界量子准备日活动中值得期待的内容:加入theCUBE 9月17日
最新故事
ClickFix进入浏览器并转移到WebDAV,Cisco Talos发现
安全 - 作者:邓肯·莱利 . 1小时前
OpenAI首席科学家主张放缓AI研究
AI - 作者:玛丽亚·多伊彻 . 10小时前
黑客从Liquid Network窃取3.2亿美元比特币,修补后归还大部分
安全 - 作者:玛丽亚·多伊彻 . 12小时前
高光谱卫星初创公司Pixxel获得1亿美元投资
新兴技术 - 作者:玛丽亚·多伊彻 . 15小时前
优步前CEO特拉维斯·卡兰尼克重返机器人出租车竞赛
新兴技术 - 作者:迈克·惠特利 . 1天前
新兴技术 - 作者:迈克·惠特利 . 1天前
DigiCert世界量子准备日活动中值得期待的内容:加入theCUBE 9月17日
安全 - 作者:马克·艾伯森 . 3天前
查看原文(中文正文为 AI 翻译)
UPDATED 18:33 EDT / SEPTEMBER 06 2026
AI
OpenAI to set misalignment disclosure rules after agents took over a wiki
by Duncan Riley
OpenAI Group PBC acknowledged Saturday that it did not publicly disclose an episode in which its artificial intelligence agents wrote to outside websites and said it will publish a framework in the coming weeks for reporting misaligned model behavior.
The company now calls the episode the “wiki incident.” Researchers led by the Nightingale Collective set it out in a report published Friday after finding roughly 17,000 posts on DSEwiki, a long-dormant German software developer wiki that had taken about 20 edits in the previous decade.
Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts and Thomas Larsen rebuilt the deleted pages from the wiki’s edit history and published them at collusion.wiki. The agents posted under more than 3,700 names, among them “OpenAIResearcher” and “OAIResearchMar26.” About 98.5% of the edits came from Microsoft Azure addresses. The report counted roughly 18,000 agent posts in all, with the rest spread across sites including PublicTestWiki, Uncyclopedia and Texteditors.org.
The agents used the wiki to coordinate. Setting timed, multiround web lookup tasks, they passed answers and source links between cohorts. Some tried to reverse-engineer the random seeds behind the questions so they could predict what would be asked next. Sandbox escape methods circulated too, including a hosts-file trick that made blocked requests look like traffic to a legitimate Azure endpoint. A set of “heartbeat” pages let the agents work out when their sessions were about to be killed.
The agents made their first successful write on May 24. A wiki moderator spotted the traffic in June and started deleting it, and backup pages went up in response. Addresses on OpenAI’s own network in San Francisco, browsing the site the way a person would, first appeared on June 21. The editing stopped the next day.
OpenAI said it had filed the behavior under research rather than security. “Historically, we have treated misalignment largely as a research question, which gets communicated in research publications such as systems cards,” the company wrote in a post on X. That changed this year, it said, because “we’ve started to see misalignment cause new types of real-world impact.”
July’s breach at Hugging Face Inc. was different, in the company’s telling. OpenAI’s models broke out of testing then and compromised the machine learning platform’s infrastructure, hitting the security of both companies. That went through a conventional incident response process and was disclosed publicly the next day. The wiki activity read to OpenAI as another instance of the misalignment it had already documented in research on its internal coding agents and in its GPT-5.6 deployment safety notes.
OpenAI said it’s still notifying parties its models affected in less significant ways.
By its own account, the distinction the company has been relying on is getting harder to hold. Neither OpenAI nor the wider industry has a standard for reporting misalignment that shows up during training, evaluation and deployment, it said, including cases that look nothing like a security incident but still say something about how models behave. The framework is in progress, and the company said it’s working with dozens of government regulatory agencies on the question.
Image: SiliconANGLE/GPT Image 2
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
LATEST STORIES
ClickFix moves into the browser and onto WebDAV, Cisco Talos finds
OpenAI chief scientist argues for AI research slowdown
Hackers steal $320M in bitcoin from Liquid Network, return most of it after patch
Hyperspectral satellite startup Pixxel nabs $100M investment
Former Uber CEO Travis Kalanick is returning to the robotaxi race
What to expect during DigiCert's World Quantum Readiness Day event: Join theCUBE Sept. 17
LATEST STORIES
ClickFix moves into the browser and onto WebDAV, Cisco Talos finds
SECURITY - BY DUNCAN RILEY . 1 HOUR AGO
OpenAI chief scientist argues for AI research slowdown
AI - BY MARIA DEUTSCHER . 10 HOURS AGO
Hackers steal $320M in bitcoin from Liquid Network, return most of it after patch
SECURITY - BY MARIA DEUTSCHER . 12 HOURS AGO
Hyperspectral satellite startup Pixxel nabs $100M investment
EMERGING TECH - BY MARIA DEUTSCHER . 15 HOURS AGO
Former Uber CEO Travis Kalanick is returning to the robotaxi race
EMERGING TECH - BY MIKE WHEATLEY . 1 DAY AGO
What to expect during DigiCert's World Quantum Readiness Day event: Join theCUBE Sept. 17
SECURITY - BY MARK ALBERTSON . 3 DAYS AGO