Anthropic and OpenAI sound the alarm on AI safety and seek to shape how it’s controlled

Two of the world's leading artificial intelligence companies, Anthropic and OpenAI, have warned of potential dangers posed by their advanced systems to humanity. These tech giants are pushing for regulation and independent testing of their cutting-edge models before releasing them to the public. The CEOs of Anthropic and OpenAI have outlined alarming scenarios in essays, social media posts, and speeches to the United Nations, aiming to shape the conversation around how their technology should be controlled.

This move may be an attempt to garner political support ahead of the U.S. midterm elections and to capitalize on the anticipated listings of their companies on the stock market.

While some experts acknowledge the companies' commitment to safety, they argue that the focus on existential risks overshadows other critical issues. For instance, AI systems are already being used in military technology to kill people, highlighting the need for a more balanced approach to AI safety. Despite the urgency, President Donald Trump has dismissed the need for new AI regulations, labeling concerns about risks to humanity as a "HOAX" designed to help China.

The companies' efforts to self-regulate and create their own auditing parameters could provide them with a competitive edge in the unregulated AI market. However, the lack of universal standards for testing AI system safety and security poses challenges for independent evaluators. As the debate over AI safety intensifies, it remains unclear whether the companies will successfully shape the conversation around their technology's control.