Tech chiefs urge caution in AI development, seek strong safety steps

At the United Nations Security Council, leaders of major artificial intelligence companies warned of the need for increased vigilance in AI development. OpenAI CEO Sam Altman emphasized the technology's potential dangers, cautioning that as AI systems become more capable and autonomous, they may move faster than institutions and concentrate power in the hands of a few.

Altman urged governments to collaborate with industry in shaping the future of AI, stating that history has shown that even competing nations can work together for the collective good when faced with a powerful new technology. Anthropic CEO Dario Amodei echoed these concerns, stating that as AI models become more powerful, even more stringent safety standards will be necessary.

He pledged to improve Anthropic's ability to prevent misuse of the technology and warned that AI could pose a risk to humanity if not managed properly. Other industry leaders, including Hugging Face CEO Clement Delangue, highlighted the importance of open-source AI in defending against potential attacks. While some, like former OpenAI and Anthropic researcher Jacob Coxon, have expressed alarm over the industry's rapid development and criticized the lack of regulation, others like Yoshua Bengui, a pioneer in the field, called for turning concern into productive action.

Despite these warnings, US President Donald Trump has resisted calls for international regulation of AI, dismissing such proposals as a "globalist scheme."