AI leaders to brief UN amid warnings the technology could slip beyond human control

Three leading AI companies - OpenAI, Anthropic, and Hugging Face - will address the UN Security Council on Wednesday, amid growing concerns that advanced AI technologies could surpass human control and endanger global security. OpenAI's Sam Altman, Anthropic's Dario Amodei, and Hugging Face's Clément Delangue are scheduled to brief the 15-member council during the annual UN General Assembly gathering.

Altman intends to propose benchmarks for evaluating AI capabilities and evaluating the safeguards companies employ in the development process. The Security Council members, including the United States and China, are also anticipated to participate in the meeting chaired by French Foreign Minister Jean-Noël Barrot. The primary goal is to highlight the practical risks of AI losing control, potentially leading to wars triggered by algorithms interacting with each other.

The US and China have already discussed establishing a notification system for AI-related incidents that pose a threat to national security during President Trump's meeting with Chinese leader Xi Jinping on Thursday. Trump expressed concerns during the UN General Assembly about the rapid advancement of AI, stating that the US aims to maintain its technological lead while encouraging its growth and closely monitoring its development through the Department of Justice.

UN Secretary-General Antonio Guterres has warned of the risks posed by rapidly advancing AI, challenging Trump's stance. Guterres established a 39-member advisory body for AI in 2023 and later created the Independent International Scientific Panel, with Yoshua Bengio, a leading AI expert, serving as co-chair.