Push for AI regulation mounts as talk of AI’s ‘existential’ risks go mainstream. But Trump resists calls for a slowdown

The story on AI regulation is heating up as the potential "existential" risks posed by artificial intelligence gain mainstream attention. Dario Amodei, CEO of Anthropic, has called for a coordinated industry safety effort to address these concerns. Anthropic has detailed the measures they are taking to ensure their AI models are used responsibly. However, China's top spy has warned that AI could pose a risk to the Communist Party.

OpenAI has been accused of violating California's new AI safety law, according to a watchdog group. Half of companies surveyed are not following their own AI governance policies. In recent days, the idea of an "existential risk" from AI has become more prevalent in conversations, which is quite unusual for a topic that has been around for decades.

Many companies seem to be developing AI technology recklessly, with some employees resigning from or continuing to work for major players such as Anthropic, OpenAI, and Google DeepMind. These warnings have dominated the global news cycle for a week, something that is rare in today's world. AI company CEOs and politicians have been stirred to respond to the growing concerns.

Altman, CEO of OpenAI, has indicated that his company is in favor of coordinating an industry-wide slowdown in AI development with rivals such as Anthropic and SpaceX. If necessary, he would tell investors that OpenAI had taken actions to prioritize safety that had cost them financially. He also stated that OpenAI would not go public this year, partly due to the current safety concerns of their latest AI models.

Despite the push for regulation, some politicians, including President Trump, are resisting calls for a slowdown. Trump believes that AI needs a strong and smart leader to guide its development.