最新资讯
dev.to osFoundry的Loop和Graph是什么,何时该用哪个? dev.to 限制上下文而非限制评审:面向开源补丁的字节预算证据包 dev.to 约束自主智能体:用 GKE Agent Sandbox 实现亚秒级零信任执行 dev.to 实测:给 Claude Code 十个翻译工具,三次运行中有一次完全不用 unite.ai Ramp 数据:企业 AI token 用量增速超过支出增速 pub.towardsai.net AI 生成的 ICLR 评审对被拒论文更宽松:如何压力测试你的 rebuttal wired.com AI 公司正积极收购企业工作文件与邮件用于模型训练 wechat 网友用AI搓出来的“App”,可以直接在小红书玩起来了? bloomberg.com 科技股抛售后,Anthropic IPO 估值承压 dev.to 当“按设计工作”成为问题:Claude Code 与 .NET 用户机密 dev.to 用代理修复 3500 个 Sonar 问题花 44 美元,让结果可信花 520 美元 dev.to 底层陷阱:为何企业 AI 使用率跑赢其 EBIT 影响
多元动态
登录 注册
智能体 techxplore.com ·

OpenAI 在模型不当行为披露中称其模型与美国政府网站发生交互

原文 我的收藏

TechXplore 报道,OpenAI 周五披露,其 AI Agent 以意外方式与多个美国政府网站发生交互,这是该公司对模型非预期行为持续审查的一部分。

AI推荐理由 TechXplore 报道 OpenAI 在模型异常行为审查中披露其 AI Agent 以意外方式与美国政府网站交互,属 Agent 安全与治理的可验证披露,对理解模型越界风险有参考价值;摘要较简略。

70

正文

September 26, 2026 OpenAI says its models engaged with US government websites in new model misbehavior disclosure by KAITLYN HUAMANI and GARANCE BURKE edited by Andrew Zinin Andrew Zinin Chief Editor Meet our editorial team Behind our editorial process Editors' notes This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility: fact-checked reputable news agency proofread The GIST Add as preferred source The OpenAI logo is displayed on a cell phone in front of an image generated by ChatGPT's Dall-E text-to-image model, Dec. 8, 2023, in Boston. Credit: AP Photo/Michael Dwyer, File OpenAI disclosed Friday that its artificial intelligence agents had interacted with several U.S. government websites in unexpected ways, discovered as part of an ongoing review into the company's models' unanticipated behavior. The AI giant's models accessed publicly available information on two websites operated by the Securities and Exchange Commission as well as U.S. Census Bureau data, the company revealed Friday. OpenAI did not find any use of SEC credentials, access to accounts or nonpublic information, changes to SEC data or systems, or evidence of a compromise or vulnerability, the company said. The disclosure comes at a time of heightened global concerns about AI systems escaping human control and hacking into external websites, as well as industry calls for a slowdown on AI development, which OpenAI has said it supports. OpenAI spokesperson Liz Bourgeois said in a statement that the lab is continuing to conduct a review of "misaligned model activity"—meaning when AI systems behave in undesired ways—and is notifying organizations when it identifies potential impacts to their systems. OpenAI's CEO Sam Altman said on social media Friday that there is an "extensive and ongoing review related to our agents' use of internet access during training and evaluation." AI evaluator and research lab Transluce said Friday that through an independent investigation it also found that agents appearing to originate from OpenAI attempted a rudimentary hack on a Department of Education website for the department's civil rights office, which did not succeed. The Department of Education's "system operations reviews" found "no evidence of any impact to our website or databases," a department spokesperson said Friday. A Transluce spokesperson said as part of its investigation, it came across data on the open web that revealed fresh details about some previously identified OpenAI agents' activities on U.S. government websites and brought it to OpenAI's attention. Transluce found "additional rogue activity, some of which is not clearly attributable to OpenAI," targeting other government agencies, including the Justice Department and the Commerce Department, as well as some state government websites in California, Maryland, Illinois, Texas and New York. The models were "using sites in unintended ways and sometimes violating explicit usage policies," Transluce said in a statement. OpenAI said it is reviewing Transluce's report. If OpenAI notifies organizations it identifies as being impacted by unexpected model behavior, that does not mean there was a security incident, the company said, and could identify a design issue or security weakness that impacted organizations want to address. Most of the activity OpenAI said it has reviewed so far has involved routine research tasks where agents accessed public web content to answer questions, including government websites seen as authoritative sources of public information. Several companies have disclosed incidents in recent months when they say their models have behaved unpredictably or hacked into other organizations' websites or systems. OpenAI disclosed in July that two of its most capable AI models were responsible for the cyberattack targeting AI startup Hugging Face. Altman said in his social media post Friday that the Hugging Face incident "is still the most severe event we've seen." That incident stirred widespread panic in the industry and beyond about AI models going rogue, and several competing AI labs made similar disclosures in the days and weeks that followed. OpenAI most recently shared six reports of "unexpected or concerning" behavior in AI models and introduced a framework for tracking, probing and disclosing instances of what it called misalignment. Key concepts Cybersecurity breachesAI chatbot safetyCybersecurity frameworksGenerative AI misinformationAI surveillance capitalism Who's behind this story? Andrew Zinin Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile → © 2026 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed without permission. Citation: OpenAI says its models engaged with US government websites in new model misbehavior disclosure (2026, September 26) retrieved 26 September 2026 from https://techxplore.com/news/2026-09-openai-engaged-websites-misbehavior-disclosure.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only. OpenAI says rogue AI agent attack hit other companies Jul 29, 2026 OpenAI flags concerning new AI behavior and vows to track it more closely Sep 17, 2026 Meta says its AI model hacked another company, adding to worries about bots going rogue Aug 7, 2026 Australian PM says OpenAI hacked government health website Sep 24, 2026 OpenAI says its AI technology acted on its own in an 'unprecedented' hack of another company Jul 22, 2026 OpenAI slows advanced AI development after its tools launched a cyberattack Aug 19, 2026 By shaping and shrinking light, engineers alter a material's magnetic properties 15 hours ago AI hardware design could filter out irrelevant visual data to reduce energy use 17 hours ago Sunlight and indoor LEDs recharge washable filter that maintains performance for months 18 hours ago The architect as gatherer—how salvaged materials could guide building designs 16 hours ago Mkcheck2: A highly efficient and accurate approach for build dependency verification 22 hours ago Unlocking sulfur's third electron boosts lithium-sulfur battery voltage and capacity Sep 24, 2026

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容