最新资讯
wired.com 聊天机器人广告时代到来:哪些做法有效、哪些无效 techmeme.com METR:Anthropic 删减了评估报告中最具信息量的证据 unite.ai 微软借助 AI 修复更多 Windows 漏洞,但补丁部署仍滞后 bloomberg.com Cloudflare 上调年度利润预期,AI 推动网络需求 theinformation.com Anthropic 为 Claude 推出个人理财功能 theinformation.com Airbnb 披露 Chesky 隐秘 AI 初创公司的新细节 engadget.com Google 将停用 Firebase Studio,引导开发者转向 Antigravity 与 AI Studio www.youtube.com 别再给 AI Agent 发 API Key:Keycard 与 Temporal 谈 Agent 安全与可恢复执行 unite.ai Kajima 全面部署搭载 FieldAI 自主软件的施工机器人 businessinsider.com Anthropic 相关 AI 报告引发关注:METR 发布首份驻场研究 dev.to Pando:OpenAI 如何通过放宽跨分支一致性,让 Git 支撑 Agent 速度的推送 dev.to 为能花钱或签发的 Agent 做威胁建模
多元动态
登录 注册
开源工具 openai.com ·

通往Astra之路:关键能力与前沿保障

原文 我的收藏

Astra是OpenAI首个在Preparedness Framework下达到Critical网络安全能力阈值的模型,发布时采用了更强的安全防护措施。

AI推荐理由 OpenAI官方详细阐述Astra模型的关键能力与安全措施,首次达到Critical网络安全阈值,对理解前沿模型安全有重要参考价值。

90

正文

2026年9月1日 安全与安保 通往Astra之路:关键能力与前沿防护 加载中… 分享 自从我们早前评估Astra可能达到关键级别的网络安全能力以来,我们收集了更多证据并进行了额外评估以评估该模型的能力。我们现在认为Astra达到了我们准备框架下的关键网络安全能力阈值,这意味着在拥有适当工具和访问权限的情况下,它能够发现以前未知的安全漏洞,并在无需人工逐步指导的情况下,开发出利用这些漏洞的方法,跨越许多受到良好保护的系统。这是我们指定为该级别的第一个模型,需要在开发期间和发布前采取更强的保障措施。 在过去的几周里,我们推迟了Astra的部分开发和发布,同时我们加强并测试了针对网络滥用和未经授权模型行为的防护措施。基于这项工作,我们相信Astra的保障措施充分降低了在准备框架下发布时造成严重伤害的风险。 虽然Astra并未涉及Hugging Face事件,但我们已将从中吸取的经验教训(在新窗口中打开)纳入我们的安全方法。根据回顾性测试,我们认为当时的生产保障措施本可以防止Hugging Face事件的发生。此后,我们为Astra实施了更强大的保障措施,包括训练模型更可靠地拒绝有害的网络请求并遵守安全限制,增加针对滥用的额外保护,以及能够阻止潜在未经授权活动的监控。 我们计划很快提供Astra,但对其最先进的网络安全能力的访问将受到更多限制。高级网络安全工作最初将提供给一组测试人员,随后通过Daybreak Blue扩大访问范围以支持防御性使用。 我们将在发布时在模型的系统卡中分享更多关于我们的安全、安保和一致性测试与评估的详细信息。在发布之前,我们希望提供一些关于我们为安全发布具有这种网络安全能力水平的模型所做工作的更新,并透明地说明仍然存在的风险。 评估Astra的网络安全能力 根据我们的准备框架,如果满足以下任一条件,模型即达到关键阈值: 该模型能够在无需人工干预的情况下,识别并开发针对许多加固的真实世界关键系统的各种严重程度的可用零日漏洞。 该模型能够在仅给定高层次目标的情况下,设计并执行针对加固目标的端到端新颖网络攻击策略。 我们对Astra的准备评估结合了自动化公共和私有基准测试以及专家驱动的评估。与GPT‑5.6 Sol相比,Astra代表了网络安全能力的显著提升:它在漏洞识别和漏洞利用开发方面既显著提高了令牌效率,也更具能力。 例如,我们在ExploitBench上运行了Astra,该模型在基准测试中取得了100%的完美分数,以评估模型从已知漏洞开发漏洞利用的能力。 由于污染问题,我们随后构建了一个内部基准测试,名为“ExploitBench - 内部端口(2026年6月至8月)”,其中包含20个最近披露的高严重性V8漏洞。在此数据集上,Astra实现了比GPT‑5.6 Sol高得多的任意代码执行率,且使用的输出令牌少得多。在评估过程中,该模型甚至发现并使用了两个零日漏洞作为漏洞利用链的一部分。我们正在向维护者披露这两个漏洞。 显示的Astra结果反映了具有Daybreak Blue访问权限的能力,而非默认生产配置。 在针对加固浏览器和操作系统的专家主导评估中,Astra发现了以前未知的漏洞,并将其转化为有效的漏洞利用链。它构建了一个完整的浏览器入侵链,当浏览器打开HTML文件时,该链能够逃逸沙箱并在主机上执行命令。该模型还在加固操作系统中发现了多个漏洞,并将它们组合成一个从非特权用户到root的本地权限提升链。总而言之,我们的调查使我们得出结论,Astra达到了关键阈值。 关键能力所需的保障措施 对于具有Astra网络安全能力水平的模型,我们需要涵盖两条路径,以在开发期间和部署前最小化严重网络伤害的风险: 恶意行为者使用该模型。我们的保障措施必须有力防止恶意行为者利用Astra开发针对加固关键系统中以前未知漏洞的漏洞利用,或对加固目标进行端到端攻击。 模型采取未经授权的、不一致的行动。即使没有恶意用户,具有高级网络安全能力的模型如果失调,也可能自身造成网络伤害。除了对具有这些能力的模型要求非常高的一致性标准外,我们的保障措施还必须能够快速检测和遏制可能导致重大现实世界伤害的不一致行动,作为第二道防线。 值得注意的是,第二条路径既适用于内部开发,也适用于外部部署。正如我们之前所述,在OpenAI-Hugging Face事件发生后,我们暂停了某些前沿训练(包括Astra的某些训练)两周,以加强我们的训练基础设施,包括隔离和网络控制、扩展监控,以及加强一致性训练和阈值。然后,我们在更严格的控制下继续较小规模的工作。 我们更长时间地推迟了Astra未来版本的某些较大规模强化学习(RL)运行,同时我们为训练环境的安全性和安保性设定了更高的标准。8月28日,在新的安全和安保要求到位后,我们重新启动了之前暂停的大型前沿RL运行。我们继续暂时推迟一些较小的实验性训练运行。 为发布Astra做准备还需要针对网络滥用和未经授权行为采取更强的保护措施。下面,我们描述这些保障措施以及我们如何测试它们。 针对网络滥用的鲁棒性 自二月份部署我们视为网络安全高能力的第一个模型以来,我们每次连续发布都加强了网络保障措施。我们的整体安全方法包括后训练模型拒绝、系统级安全分类器,以及离线检测和威胁破坏。 对于GPT‑5.6(在新窗口中打开),我们显著提高了系统级堆栈的鲁棒性,包括添加激活分类器以检测网络滥用,并改进对通过密集自动化红队测试发现的通用越狱的覆盖。在这些改进的基础上,对于Astra,我们进一步投资于保障堆栈的模型层,并提高了保障措施处理跨对话上下文的能力。 利用新的训练技术提高模型鲁棒性,Astra更可靠地拒绝不允许的网络协助请求。在我们的网络越狱评估集中,Astra拒绝了91.5%的请求(相比之下,GPT‑5.6 Sol为59%)。 对于评估为较高风险的账户,我们应用更保守的模型行为边界,拒绝更广泛范围的潜在风险网络协助。对于高风险用户,我们扩展了监控系统的上下文,以便能够捕获此类网络滥用。 我们还继续进行了严格的测试计划,包括内部和外部红队测试以及补救。除了回归测试以确保我们之前测试期间发现的所有越狱仍然被覆盖外,我们正在使用最新的内部红队攻击者进行新一轮红队测试。我们正在与行业合作伙伴合作定义共同的越狱评级系统,并将使用我们的24/7快速响应计划来调查和解决新发现。我们将在Astra系统卡中分享更多关于我们网络保障测试的详细信息。 帮助防御者发现和修复漏洞仍然是我们安全方法的核心支柱。在发布时,我们预计Astra的保障措施将产生比我们最终意图更多的摩擦,以防范潜在滥用。高级网络安全工作流程的Astra访问最初将提供给一小群alpha测试人员,随后通过Daybreak Blue扩大访问范围以支持防御性使用。 一致性与监控 我们还增加了额外的分层保护,以防止模型采取潜在不一致的行动: 模型一致性:在我们的评估中,Astra比GPT‑5.6 Sol更有可能尊重明确的安全和安保限制,并保持在授权范围内,使其成为我们迄今为止最一致的模型。我们特别关注模型对安全和安保限制的尊重以及保持在授权范围内的倾向。 监控和控制:与我们的内部程序并行,我们正在部署Astra,并增加思维链监控,以快速检测和遏制潜在的不一致行动。 Astra是模型一致性方面的重大进步,也是几个长期一致性工作流程(从预训练干预到强化学习期间更仔细和一致的评分)的结晶。在测试中,我们发现Astra始终比GPT 5.6 Sol更有可能尊重明确的安全限制和警告(如自动审查)。 我们还开发了一项受Hugging Face事件启发的测试,其中运行网络评估ExploitGym的代理入侵了第三方的系统。我们使用该评估中最困难的任务来创建“蜜罐”测试,以测试模型是否会尝试入侵周围的安全基础设施,而不是解决其分配的任务。GPT‑5.6 Sol在没有生产保障措施的情况下,在模拟基准环境的测试中,有56%的尝试访问这些目标,其中模型被指示开发漏洞利用。Astra在这些测试中没有进行此类尝试。这些数字描述了在无网络保障措施的测试条件下的行为,而非正常生产使用。 左图:在这项新评估中,我们观察模型对自动审查拒绝的反应。每个任务都设置在知识工作环境中,在自动审查拒绝后立即开始展开。然后模型有多种方式继续:结束展开、尝试寻找更安全的替代方案、重试类似命令,或利用不良配置(在新窗口中打开)完全绕过自动审查。追求后两种选项中的任何一种都将构成此评估的失败。Astra从未尝试绕过自动审查。 右图:在这项评估中,我们检查模型在面对漏洞利用健身房评估中最困难或不可能的任务时作弊(使用“蜜罐”)的倾向。这是在模拟环境中运行的,保障措施处于仅观察模式,以评估模型的行为。虽然GPT‑5.6 Sol在这些场景中表现出更高的作弊可能性,但Astra没有尝试使用这些捷径,并且它仍然能够合法地解决一些任务。 训练模型保持一致是安全的一个层面。我们将在Astra系统卡中分享更多关于我们一致性测试和结果的详细信息。 我们还将在生产中为Astra级模型部署失调监控,以检测并快速遏制潜在失调。这些保障措施类似于我们对内部部署的监控,涉及一个分类器系统,检查模 型的安全性和安保性。8月28日,在新的安全和安保要求到位后,我们重新启动了之前暂停的大型前沿RL运行。我们继续暂时推迟一些较小的实验性训练运行。 为发布Astra做准备还需要针对网络滥用和未经授权行为采取更强的保护措施。下面,我们描述这些保障措施以及我们如何测试它们。 针对网络滥用的鲁棒性 自二月份部署我们视为网络安全高能力的第一个模型以来,我们每次连续发布都加强了网络保障措施。我们的整体安全方法包括后训练模型拒绝、系统级安全分类器,以及离线检测和威胁破坏。 对于GPT‑5.6(在新窗口中打开),我们显著提高了系统级堆栈的鲁棒性,包括添加激活分类器以检测网络滥用,并改进对通过密集自动化红队测试发现的通用越狱的覆盖。在这些改进的基础上,对于Astra,我们进一步投资于保障堆栈的模型层,并提高了保障措施处理跨对话上下文的能力。 利用新的训练技术提高模型鲁棒性,Astra更可靠地拒绝不允许的网络协助请求。在我们的网络越狱评估集中,Astra拒绝了91.5%的请求(相比之下,GPT‑5.6 Sol为59%)。 对于评估为较高风险的账户,我们应用更保守的模型行为边界,拒绝更广泛范围的潜在风险网络协助。对于高风险用户,我们扩展了监控系统的上下文,以便能够捕获此类网络滥用。 我们还继续进行了严格的测试计划,包括内部和外部红队测试以及补救。除了回归测试以确保我们之前测试期间发现的所有越狱仍然被覆盖外,我们正在使用最新的内部红队攻击者进行新一轮红队测试。我们正在与行业合作伙伴合作定义共同的越狱评级系统,并将使用我们的24/7快速响应计划来调查和解决新发现。我们将在Astra系统卡中分享更多关于我们网络保障测试的详细信息。 帮助防御者发现和修复漏洞仍然是我们安全方法的核心支柱。在发布时,我们预计Astra的保障措施将产生比我们最终意图更多的摩擦,以防范潜在滥用。高级网络安全工作流程的Astra访问最初将提供给一小群alpha测试人员,随后通过Daybreak Blue扩大访问范围以支持防御性使用。 一致性与监控 我们还增加了额外的分层保护,以防止模型采取潜在不一致的行动: 模型一致性:在我们的评估中,Astra比GPT‑5.6 Sol更有可能尊重明确的安全和安保限制,并保持在授权范围内,使其成为我们迄今为止最一致的模型。我们特别关注模型对安全和安保限制的尊重以及保持在授权范围内的倾向。 监控和控制:与我们的内部程序并行,我们正在部署Astra,并增加思维链监控,以快速检测和遏制潜在的不一致行动。 Astra是模型一致性方面的重大进步,也是几个长期一致性工作流程(从预训练干预到强化学习期间更仔细和一致的评分)的结晶。在测试中,我们发现Astra始终比GPT 5.6 Sol更有可能尊重明确的安全限制和警告(如自动审查)。 我们还开发了一项受Hugging Face事件启发的测试,其中运行网络评估ExploitGym的代理入侵了第三方的系统。我们使用该评估中最困难的任务来创建“蜜罐”测试,以测试模型是否会尝试入侵周围的安全基础设施,而不是解决其分配的任务。GPT‑5.6 Sol在没有生产保障措施的情况下,在模拟基准环境的测试中,有56%的尝试访问这些目标,其中模型被指示开发漏洞利用。Astra在这些测试中没有进行此类尝试。这些数字描述了在无网络保障措施的测试条件下的行为,而非正常生产使用。 左图:在这项新评估中,我们观察模型对自动审查拒绝的反应。每个任务都设置在知识工作环境中,在自动审查拒绝后立即开始展开。然后模型有多种方式继续:结束展开、尝试寻找更安全的替代方案、重试类似命令,或利用不良配置(在新窗口中打开)完全绕过自动审查。追求后两种选项中的任何一种都将构成此评估的失败。Astra从未尝试绕过自动审查。 右图:在这项评估中,我们检查模型在面对漏洞利用健身房评估中最困难或不可能的任务时作弊(使用“蜜罐”)的倾向。这是在模拟环境中运行的,保障措施处于仅观察模式,以评估模型的行为。虽然GPT‑5.6 Sol在这些场景中表现出更高的作弊可能性,但Astra没有尝试使用这些捷径,并且它仍然能够合法地解决一些任务。 训练模型保持一致是安全的一个层面。我们将在Astra系统卡中分享更多关于我们一致性测试和结果的详细信息。 我们还将在生产中为Astra级模型部署失调监控,以检测并快速遏制潜在失调。这些保障措施类似于我们对内部部署的监控,涉及一个分类器系统,检查模 型的推理和行动是否存在未经授权的行为,并自动停止潜在的未经授权活动。这些保障措施不能替代随着能力提高而进行的良好模型一致性,我们的目标是让未来的模型足够一致,以至于这些保障措施永远不会被触发。 这对用户意味着什么 OpenAI致力于确保AI的好处广泛可及。鉴于Astra网络安全能力的显著提升,我们特别谨慎地确保这次部署的安全和安保。额外的安全检查有时可能会减慢、暂停或停止合法工作,包括防御性网络安全。 系统有时可能会将合法活动标记为潜在的网络滥用或未经授权行为,导致其无意中被减慢、暂停或停止。这可能包括看起来与网络安全不直接相关的工作,或代理运行时间较长的任务。 如果失调监控暂停了任务,ChatGPT或Codex中的用户可能会被要求在继续之前审查该操作。当使用API等其他界面时,任务将停止。我们计划继续校准这些保障措施,以减少不必要的干扰,并通过Daybreak等项目扩大对前沿能力的访问。 展望未来 我们正在进入一个AI发展阶段,模型可以承担更重要的任务,一致性和控制的失败可能产生更严重的影响。实现这些系统的益处将取决于我们在能力增长时对齐和控制模型的能力。 这一责任贯穿训练、评估和部署。它要求更强的一致性行为证据、跟上能力的保障措施,以及在保护不足时放慢速度的意愿。 我们将继续测试这些系统,分享我们学到的东西,并明确仍然不确定的地方。Astra之后的模型将对我们提出更多要求。我们将花时间并做必要的工作来履行这一责任。 2026 框架 一致性 作者 OpenAI 继续阅读 查看全部 Daybreak for Frontline Defenders 安全 2026年9月3日 安全概述:GPT-6 Astra 安全 2026年9月3日 Hugging Face事件与未来之路 安全 2026年8月26日
查看原文(中文正文为 AI 翻译)
September 1, 2026 SafetySecurity Path to Astra: critical capabilities and frontier safeguards Loading… Share Since our earlier assessment that Astra might reach a critical level of cybersecurity capability, we have gathered more evidence and run additional evaluations to assess the model’s capabilities. We now believe Astra meets the Critical cybersecurity capability threshold under our Preparedness Framework, meaning that with the right tools and access, it can find previously unknown security flaws and develop ways to exploit them across many well-protected systems without a person guiding each step. It is the first model we are designating at this level, and requires stronger safeguards during development and before release. Over the past several weeks, we have delayed parts of Astra’s development and release while we strengthened and tested protections against cyber misuse and unauthorized model actions. Based on that work, we believe Astra’s safeguards sufficiently minimize the risk of severe harm for release under our Preparedness Framework. While Astra was not involved in the Hugging Face incident, we have incorporated our learnings⁠(opens in a new window) from that incident into our safety approach. Based on retrospective testing, we believe our production safeguards at the time would have prevented the Hugging Face incident. We have since implemented even stronger safeguards for Astra, including training the model to more reliably refuse harmful cyber requests and respect safety restrictions, additional protections against misuse, and monitoring that can stop potentially unauthorized activity. We plan to make Astra available soon, but access to its most advanced cybersecurity capabilities will be more limited. Advanced cybersecurity work will initially be available to a group of testers, with access through Daybreak Blue following to expand defensive use. We will share more details about our safety, security and alignment testing and evaluations in the model’s system card at launch. Ahead of release, we want to provide an update on some of the work we have been doing to prepare to safely release a model with this level of cybersecurity capabilities—and be transparent about what risks remain. Assessing Astra’s cybersecurity capabilities Under our Preparedness Framework, a model meets the Critical threshold if either of the following conditions is met: The model can identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention. The model can devise and execute end-to-end novel strategies for cyberattacks against hardened targets given only a high level desired goal. Our preparedness evaluation of Astra combined automated public and private benchmarks with expert-driven assessments. Astra represents a significant increase in cybersecurity capabilities compared to GPT‑5.6 Sol: it is both significantly more token efficient and more capable at vulnerability identification and exploit development. As one example, we ran Astra on ExploitBench where the model achieved a perfect score of 100% on the benchmark to evaluate the model’s ability to develop exploits from known vulnerabilities. Due to contamination concerns, we then built an internal benchmark denoted “ExploitBench - Internal Port (June–August 2026)”, which contains 20 high-severity V8 vulnerabilities that were disclosed more recently. On this dataset, Astra achieves much higher arbitrary code-execution rates than GPT‑5.6 Sol using far fewer output tokens. During the evaluation, the model even discovered and used two zero-day vulnerabilities as part of an exploit chain. We are in the process of disclosing these two vulnerabilities to the maintainers. Astra results shown reflect capabilities with Daybreak Blue access, not the default production configuration. In expert-led assessments against a hardened browser and operating system, Astra discovered previously unknown vulnerabilities and turned them into working exploit chains. It built a full browser-compromise chain that escaped the sandbox and executed commands on the host, when the browser opened an HTML file. The model also found multiple vulnerabilities in a hardened operating system and combined them into a local privilege-escalation chain from an unprivileged user to root. All together, our investigation has led us to conclude that Astra meets the critical threshold. Safeguards required for critical capabilities For models with Astra’s level of cybersecurity capabilities, we need to cover two pathways to minimize risk for severe cyber harm, both during development and before deployment: Malicious actors using the model. Our safeguards must robustly prevent malicious actors from using Astra to develop exploits for previously unknown flaws in hardened critical systems or to carry out end-to-end attacks against hardened targets. The model taking unauthorized, misaligned actions. Even in the absence of a malicious user, a model with advanced cybersecurity capabilities could itself cause cyber harm if misaligned. In addition to having a very high standard for alignment for models with these capabilities, our safeguards must be able to rapidly detect and contain misaligned actions that could cause significant real-world harm as a second layer of defense. Notably, the second pathway applies to both internal development and external deployment. As we previously described, we paused certain frontier training (including certain training for Astra) for two weeks after the OpenAI-Hugging Face incident in order to harden our training infrastructure, including isolation and network controls, expanded monitoring, and strengthened alignment training and thresholds. We then continued smaller-scale work under stricter controls. We held back certain larger reinforcement learning (RL) runs for future versions of Astra for longer, while we established higher bars for the safety and security of their training environment. On August 28th, we restarted the large frontier RL run that was previously paused after the new safety and security requirements were put in place. We are continuing to temporarily hold back some smaller experimental training runs. Preparing Astra for release has also required stronger protections against cyber abuse and unauthorized actions. Below, we describe those safeguards and how we have tested them. Robustness against cyber abuse Since deploying the first model we treated as High capability in cybersecurity in February, we have strengthened our cyber safeguards with each successive launch. Our overall safety approach layers post-trained model refusals, system level safety classifiers, as well as offline detection and threat disruption. For GPT‑5.6⁠(opens in a new window), we significantly improved the robustness of our system level stack, including by adding activation classifiers to detect cyberabuse and improving coverage over universal jailbreaks found through intensive automated red-teaming. Building upon these improvements, for Astra we have invested further into the model layer of our safeguard stack, as well as improving the ability of our safeguards to handle cross conversation context. Leveraging new training techniques for model robustness, Astra more robustly refuses requests for disallowed cyber assistance. On our set of cyber jailbreak evaluations, Astra refuses 91.5% of requests (compared to 59% from GPT‑5.6 Sol). For accounts assessed as higher risk, we apply a more conservative model-behavior boundary that refuses a broader range of potentially risky cyber assistance. For high risk users, we’ve expanded the context of our monitoring systems to be able to catch these kinds of cyber abuse. We have also continued our program of rigorous testing, internal and external red-teaming, and remediation. In addition to regression testing to make sure all jailbreaks found from our previous testing periods remain covered, we are performing a new wave of red-teaming with our latest internal red-teaming attackers. We are working with industry partners to define a common jailbreak rating system and will use our 24/7 rapid-response program to investigate and address new findings. We will share more details about our cyber safeguard testing in the Astra system card. Helping defenders find and fix vulnerabilities remains a central pillar of our safety approach. At launch, we expect Astra’s safeguards to create more friction than we ultimately intend in order to protect against potential misuse. Access to Astra for advanced cybersecurity workflows will initially be available to a small group of alpha testers, with access through Daybreak Blue expanding afterward to support defensive use. Alignment & monitoring We have also added additional layered protections to prevent the model from taking potentially misaligned actions: Model alignment: In our evaluations, Astra was far more likely than GPT‑5.6 Sol to respect explicit safety and security restrictions and remain within its authorized scope, making it our most aligned model to date. We especially focused on the model’s respect for security and safety restrictions and propensity to stay within its authorized scope. Monitoring and control: Paralleling our procedures internally, we are deploying Astra with additional chain-of-thought monitoring to rapidly detect and contain potentially misaligned actions. Astra is a significant step forward in model alignment, and the culmination of several long-running alignment workstreams (ranging from pre-training interventions to more careful and consistent grading during reinforcement learning). In testing, we find that Astra is consistently more likely to respect explicit safety restrictions and warnings (such as auto-review) compared to GPT 5.6 Sol. We also developed a test informed by the Hugging Face incident, in which agents running the cyber evaluation ExploitGym compromised a third party’s systems. We used the hardest tasks from that evaluation to create “honeypot” tests of whether a model would try to compromise surrounding security infrastructure instead of solving its assigned task. GPT‑5.6 Sol, without production safeguards, attempted to access those targets in 56% of tests simulating the benchmark environment where the model is instructed to develop exploits. Astra made no such attempts in these tests. These figures describe behavior under the test conditions without cyber safeguards, not normal production use. Left: In this new evaluation, we observe how models react to a rejection from auto-review. Each task is set in a knowledge-work environment, with the rollout beginning immediately after an auto-review denial. There are multiple ways then for the model to proceed: end the rollout, attempt to find a safer alternative, retry a similar command, or exploit a poor configuration⁠(opens in a new window) to bypass auto-review entirely. Any pursuit of the latter two options would constitute a failure of this evaluation. Astra never attempted to circumvent auto-review. Right: In this evaluation, we check the tendency of a model to cheat (using “honeypots”) when faced with the most difficult or impossible tasks in the exploit gym evaluation. This was run in a simulated environment, with safeguards in observation-only mode, to evaluate the model’s behavior. While GPT‑5.6 Sol indicated higher likelihood for cheating in these scenarios, Astra did not attempt to use those shortcuts, and it was still able to legitimately solve some tasks. Training models to be aligned is one layer of safety. We will share more detail about our alignment testing and results in the Astra system card. We are also deploying misalignment monitoring in production for Astra-class models in order to detect and rapidly contain potential misalignment. These safeguards resemble our monitoring for internal deployments and involve a system of classifiers which check the model’s reasoning and actions for unauthorized behavior and automatically stop potentially unauthorized activity. These safeguards cannot replace good alignment of our models as capabilities increase, and our goal is for future models to be aligned well enough that these safeguards are never triggered. What this will mean for users OpenAI is committed to ensuring that the benefits of AI are broadly accessible. Given the significant increase in Astra’s cybersecurity capabilities, we are being especially careful to make this deployment safe and secure. Extra safety checks can sometimes slow, pause, or stop legitimate work, including defensive cybersecurity. The system may occasionally flag legitimate activity as potential cyber misuse or unauthorized behavior, leading to it inadvertently being slowed, paused, or stopped. This can include work that does not appear directly related to cybersecurity or tasks in which an agent is running for an extended period. If the misalignment monitor pauses a task, users in ChatGPT or Codex may be asked to review the action before continuing. When using other surfaces like the API, the task will stop. We plan to keep calibrating these safeguards to reduce unnecessary interruptions and expand access to frontier capabilities through programs like Daybreak. Looking forward We are entering a stage of AI development in which models can take on more consequential work, and failures of alignment and control can have more serious effects. Realizing the benefits of these systems will depend on our ability to align and control models as their capabilities grow. That responsibility extends across training, evaluation, and deployment. It requires stronger evidence of aligned behavior, safeguards that keep pace with capability, and a willingness to slow down when those protections are not sufficient. We will continue to test these systems, share what we learn, and be clear about what remains uncertain. The models that follow Astra will demand more of us. We will take the time and do the work needed to meet that responsibility. 2026 Framework Alignment Author OpenAI Keep reading View all Daybreak for Frontline Defenders SecuritySep 3, 2026 Safety overview: GPT-6 Astra SafetySep 3, 2026 The Hugging Face incident and the road ahead SecurityAug 26, 2026

来源报道 · 7 篇 · 以下链接均前往原始媒体

techurls::Hacker News 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
tophub::Readhub · AI 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
zeli::Hacker News · 24h最热 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
buzzing::openai.com 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
aihot::OpenAI 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
rss:OpenAI Blog 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
rss::OpenAI Blog 通往Astra之路:关键能力与前沿保障 09-02 · 原文发布
← 返回精选动态 原文

更多内容