行业动态
x.com ·
@sama
Sam Altman：AI 可能走向糟糕的两个方向，以及'节奏控制不等于停止'
Sam Altman 发帖称 AI 进展可能以两种糟糕方式发展：一是人类失去对未来的控制，二是权力过度集中（单一国家或单一实验室掌握超强 AI）。他主张走狭窄的中间路径，并引用其前帖说明：欢迎为前沿 AI 设定一致安全要求的联邦框架，但不必等待反垄断豁免或立法；OpenAI 现在会在预期显著提升能力的前沿强化学习训练前预先制定明确的安全案例，并称'pacing（节奏控制）'不等于'停止'，安全干预虽有成本但值得。
AI推荐理由 Sam Altman 提出 AI 进展可能走向糟糕的两个方向：失去对未来的控制、权力过度集中，并主张走'狭窄中间路径'。该帖引用了其前一条关于前沿实验室安全责任、联邦监管框架、安全案例（safety cases）与'pacing 不等于 stopping'的完整论述，包含 OpenAI 在 frontier RL 训练前预先制定安全案例等具体做法，属于一线实验室负责人对 AI 安全治理的公开表态，信息密度较高。
78
浏览 1,760,640
点赞 12,649
评论 2,610
转发 1,225
正文
There are two ways AI progress could go very badly and that we must avoid.
First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people. To ensure that, we need ways to ensure that alignment and safety techniques stay ahead of progress in model capabilities.
Second, we could end up in a world with too much concentration of power. If an extraordinarily powerful AI is used by one person or company to impress their worldview onto everyone else, the results could be extremely dystopian.
Avoiding these two threats requires walking a narrow middle path; for example, one country could gain too much power. Another example is one lab ending up with too much power.