OpenAI 的 Altman 与 Anthropic 的 Amodei 在联合国安理会就 AI 安全作简报

Dario Amodei addresses the United Nations security council in New York City on Wednesday. Photograph: Brendan McDermid/Reuters View image in fullscreen Dario Amodei addresses the United Nations security council in New York City on Wednesday. Photograph: Brendan McDermid/Reuters OpenAI’s Altman and Anthropic’s Amodei address UN security council Heads of two of the world’s largest artificial intelligence companies give separate briefings on AI safety Sam Altman of OpenAI and Dario Amodei of Anthropic, heads of two of the world’s largest artificial intelligence companies, addressed the United Nations security council on Wednesday in separate briefings on AI safety. “We have a choice in front of us,” Altman told the council. “AI can either be more like a new renaissance of creativity and discovery, or more like a new industrial revolution of upheaval and disarray.” Altman and Amodei spoke as their companies face increasing scrutiny over the safety of their products. Public alarm over AI has grown in response to warnings from Anthropic researchers earlier this month that the technology could destroy humanity within the decade. Leaders of AI companies, including Altman and Amodei, have since called for a slowdown on advancing AI and more international cooperation on the technology’s safety standards. Altman, who sat at the corner of the security council’s horseshoe-shaped table and spoke for about 10 minutes, touted AI’s benefits to productivity while also warning of its potential abuses. He advocated for governments to come together to build a future where AI is guided by democratic institutions, rather than one where people feel like the technology is “something being done to them”. View image in fullscreen Sam Altman during a UN security council meeting on artificial intelligence in New York City on Wednesday. Photograph: Angela Weiss/AFP/Getty Images “If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone. They must be shaped through democratic processes and by governments accountable to the people that they serve,” Altman said. The OpenAI CEO’s speech contrasted with some of his company’s lobbying efforts and the political action committee of its president, Greg Brockman. The pro-AI Leading the Future PAC has accrued more than $100m and spent millions targeting candidates who support stronger regulation on the AI industry. Altman’s speech also nodded to some of the concerns from Anthropic researchers about AI’s existential risk, warning the council against falling into “doomerism”. Altman argued there was instead a “middle path” through the safety debate that should be based on three principles: AI systems must remain under human control; AI must benefit people, from helping doctors treat patients to boosting entrepreneurs; and the technology must “empower people individually”. Amodei, who addressed the council via video call, repeated many of the points that he made in a 12 September blog post that called for increased global cooperation and oversight of AI. He advocated for several forms of international agreements, including a ban on using AI to develop biological weapons and global standards for testing new AI models. While Altman steered his address away from engaging with the warnings of existential risk that have made headlines this month, Amodei reiterated his concerns about developers losing control of AI while also framing his company as an industry leader on safety. skip past newsletter promotion after newsletter promotion “If managed poorly, I even believe that AI could be a risk to humanity as a whole,” Amodei said. “At Anthropic, we believe we have the best track record in the industry for preventing these risks”. AI regulation has shot up the political agenda after researchers at OpenAI’s arch-rival Anthropic warned the technology could wipe out humanity within years. These concerns are a regular refrain within sections of the AI community, who fear the technology could trigger devastation for a variety of reasons ranging from aiding development of bioweapons to triggering a financial catastrophe. Earlier, Amodei called for a slowdown in AI development, which was supported by OpenAI, Google and Elon Musk. Both Amodei and Altman have long cast themselves as stewards of AI and sought to shape how the technology is publicly received. Their companies are also jockeying for the lead in the AI race, with both eyeing potentially record-setting initial public offerings that would value each at more than $1.5tn. Explore more on these topics United Nations AI (artificial intelligence) Sam Altman Anthropic OpenAI New York US foreign policy Share Reuse this content