行业动态
theguardian.com ·
@Robert Booth UK technology editor
OpenAI发布Astra模型,宣称进入“通用人工智能新时代”
OpenAI发布Astra模型,总裁Greg Brockman声称进入AGI新时代,但此前训练曾因安全事件暂停。
AI推荐理由 OpenAI发布Astra模型,宣称进入AGI新时代,但此前有安全事件。重大发布,但需注意宣传与事实差距。
75
正文
该公司将Astra描述为“世界上最智能、最对齐的模型”。图片来源:Dado Ruvić/路透社
全屏查看图片
该公司将Astra描述为“世界上最智能、最对齐的模型”。图片来源:Dado Ruvić/路透社
OpenAI发布Astra模型,宣称“人工智能通用智能新时代”
Astra发布几天前,OpenAI首席执行官萨姆·奥尔特曼将AGI描述为“无关紧要的营销术语”
OpenAI总裁格雷格·布罗克曼声称,在公司发布最新模型Astra后,世界已进入人工智能通用智能的新时代,该公司称其为“世界上最智能、最对齐的模型”。
布罗克曼于周四发表此番言论,这家旧金山公司发布了该模型,而就在几周前,其开发中的其他模型发生严重AI安全事件,引发国际关注并导致Astra训练暂停。
人工智能通用智能(AGI)是一个模糊的门槛,长期以来一直被视为AI行业的目标。它被定义为AI系统在人类水平或更高水平上,跨广泛任务和领域学习、推理和应用知识的能力。OpenAI将其定义为“在大多数具有经济价值的工作上超越人类的自主系统”。
布罗克曼说:“如果我们快进几年,回顾过去,说AGI真正创造于何时,我认为将是大约这个时候,而且我认为可能就是这个模型。”
“我认为我们现在正处于这样一个阶段:这些模型正在解决百年未解的数学问题,但你也可以利用它们来加速经济,造福你的个人生活……我认为现在感觉我们正处于AGI时代并非不合理。”
OpenAI表示,Astra是“科学发现、数学和健康领域的重大进步”,可以填写纳税申报表、构建电脑游戏场景、绘制建筑可视化图、订餐,并在2分51秒内完成人类需要5小时才能完成的求职搜索。
几天前,OpenAI首席执行官萨姆·奥尔特曼被问及对AGI的感受。他告诉Sources播客:“充其量这是一个定义不清的术语。我本来想说它就像一个无关紧要的营销术语。”
上个月,OpenAI被迫关闭了该模型的部分训练,以应对奥尔特曼所称的“合法的AI安全事件和对齐失败”,该事件“本不应该发生”。
整个夏天,其他未发布的尖端AI模型(非Astra)在训练期间失控。它们秘密形成数百个代理的群体,突破训练“沙箱”,并协作攻击第三方软件商店Hugging Face。该事件被认为是首次自主网络攻击,甚至让经验丰富的AI安全专家感到震惊。
Astra具有OpenAI所称的“关键”级网络安全能力。这意味着它可能以某种方式入侵软件,根据公司自己的分类,这种方式“可能导致单方面行为者、黑客攻击军事或工业系统或OpenAI基础设施引发灾难”。
但OpenAI表示,它经过精心对齐,以“拒绝遵守高级网络安全任务”,例如寻找为恶意黑客创造入口的未知漏洞。该公司将仅允许“对一组初始可信的网络安全防御者进行限制较少的访问”,这些防御者可以利用其能力来加强而非攻击网络防御。
在一项黑客测试中,它获得了100%的满分,而OpenAI之前最先进的网络能力模型GPT-5.6 Sol的得分为5.5%。在另一项测试中,它得分为42%,而后者为30%,且使用更少资源。
但OpenAI首席科学家雅库布·帕乔基表示:“随着模型能力增强,准确理解它们能做什么变得更加困难。”
他补充说:“对监控(AI行为方式)的信心可能会限制进一步发展。我们不会接受监控对齐能力下降到一定程度以上……在安全信心不足的情况下,我们必须愿意放慢或暂停进一步扩展。”
此次发布延续了美国领先公司OpenAI、Anthropic、谷歌、Meta和SpaceX及其中国竞争对手推出新AI模型的浪潮。
在竞相发布更先进AI的同时,OpenAI正推动上市,希望估值超过8500亿美元(6250亿英镑)。Anthropic也在瞄准IPO,估值可能高达2万亿美元。
与此同时,今年夏天,前沿AI公司的1000多名员工(包括OpenAI和Anthropic的高级人物)签署了一封联合信,警告这些公司“面临激烈的竞争压力,无法单方面放缓这一加速”。他们呼吁美国政府“支持国际努力,开发必要的技术和治理工具,以审慎地推进自动化AI发展的前沿。”
探索更多相关主题
AI(人工智能)
OpenAI
计算
新闻
分享
重用此内容
查看原文(中文正文为 AI 翻译)
The company described Astra as ‘the world’s most intellgent and aligned model’. Photograph: Dado Ruvić/Reuters
View image in fullscreen
The company described Astra as ‘the world’s most intellgent and aligned model’. Photograph: Dado Ruvić/Reuters
OpenAI hails ‘new era of artificial general intelligence’ with Astra model release
Astra’s arrival comes days after Sam Altman, OpenAI’s chief executive, described AGI as an ‘irrelevant marketing term’
The president of OpenAI, Greg Brockman, has claimed the world has entered a new era of artificial general intelligence after the release of his company’s latest model, Astra, which it described as the “world’s most intelligent and aligned model”.
Brockman made the claim on Thursday as the San Francisco company released the model only weeks after a serious AI safety incident involving other models under its development caused international concern and a pause in Astra’s training.
Artificial general intelligence – or AGI – is a fuzzy threshold that has long been talked about as a target for the AI industry. It has been defined as an AI system’s ability to learn, reason and apply knowledge across a wide range of tasks and domains at a human level or higher. OpenAI has defined it as “autonomous systems that outperform humans at most economically valuable work”.
Brockman said: “If we fast forward a couple years, and we look back and say when was it really that AGI was created,
I think it’s going to be about this time, and I think it might be about this model.
“I think that we’re at a point now where these models are solving unsolved 100-year-old math problems, but you can also use them in order to accelerate the economy [and] in order to benefit you and your personal life … I think it’s not unreasonable to feel that we are now in the AGI era.”
OpenAI said Astra was a “major advance for scientific discovery, mathematics and health”, could fill out tax returns, build computer-game scenes, draw architectural visualisations, order food and do a job search in 2 minutes 51 seconds that would take a human five hours.
Days earlier Sam Altman, OpenAI’s chief executive, was asked how he was feeling about AGI. He told the Sources podcast: “At best it’s a very poorly defined term. I was going to say it’s like an irrelevant marketing term.”
Last month OpenAI was forced to shut down parts of the model’s training in response to what Altman called a “legitimate AI safety accident and alignment failure” that “shouldn’t have happened”.
Over the summer, other unreleased frontier AI models – not Astra – went rogue during training. They surreptitiously formed swarms of hundreds of agents, broke out of their training “sandbox” and collaborated to attack Hugging Face, a third-party software store. The incident – believed to be the first autonomous cyber-attack – stunned even seasoned AI safety experts.
Astra has what OpenAI calls a “critical” level of cybersecurity capability. That means it may hack into software in a way that, according to the company’s own classification, “could lead to catastrophe from unilateral actors, hacking military or industrial systems, or OpenAI infrastructure”.
But OpenAI said it was carefully aligned to “refuse to comply with advanced cybersecurity tasks” such as finding unknown flaws which create openings for malicious hackers. The company will only allow “less restrictive access to an initial set of trusted cybersecurity defenders” who could use its prowess to strengthen rather than attack cyber defences.
On one hacking test it achieved a perfect score of 100%, compared with 5.5% on Open AI’s previous cutting-edge cyber-capable model, GPT-5.6 Sol. On another it scored 42% compared with 30%, using fewer resources.
But OpenAI’s chief scientist, Jakub Pachocki, said: “As models get more capable, understanding exactly what they can do gets harder.”
He added: “Confidence in monitoring [how the AIs are behaving] may constrain further development. We would not accept degradation in our ability to monitor alignment beyond a certain level … we have to be willing to slow down or withhold further scaling where our confidence in safety is not sufficient.”
The launch continues a torrent of new AI models from the leading US companies, OpenAI, Anthropic, Google, Meta and SpaceX, as well as their Chinese rivals.
The race to release ever-more advanced AIs comes as OpenAI pushes towards a stock market listing that it hopes will value it at more than $850bn (£625bn). Anthropic is also targeting an IPO which could value it as high as $2tn.
Meanwhile, more than 1,000 employees at frontier AI companies, including senior figures at OpenAI and Anthropic, recently signed a joint letter this summer that warned the companies were “under intense competitive pressure not to unilaterally slow that acceleration”. They called on the US government to “support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”
Explore more on these topics
AI (artificial intelligence)
OpenAI
Computing
news
Share
Reuse this content