Anthropic boss Dario Amodei calls for AI development to slow down

Dario Amodei, the CEO of AI company Anthropic, has called for a slowdown in the development of artificial intelligence models and greater oversight of their creation. In an online essay titled "We Must Pace the Frontier," Amodei argued that while AI development is not the issue, the associated risks are serious. He urged companies and governments to take time to address these risks. Amodei's proposal includes independent monitoring of AI models during development, industry-wide regulation, and global regulation.

The idea resonated with other AI industry leaders, including OpenAI CEO Sam Altman and Tesla CEO Elon Musk, both of whom agreed with Amodei's stance. However, these calls for caution come amid growing concerns about the potential risks of AI technology. An ex-Anthropic researcher told the BBC that a lack of slowing down could lead to humanity's extinction in the near future. This has sparked a debate about the appropriate pace of AI development and the need for safety measures.

While Amodei has received support from some industry leaders, others, such as former President Donald Trump, have dismissed these concerns. Trump argued that not keeping pace with AI development could put the US at a disadvantage. However, safety has emerged as a key issue in the rivalry between Anthropic and OpenAI. Amodei, who previously worked at OpenAI, co-founded Anthropic in 2021 with the goal of building safer and more trustworthy AI models.

Amodei acknowledged that regulation may not keep pace with the rapid advancement of AI technology. Instead, he called for voluntary collaboration among companies to establish standards and for third-party evaluators to ensure the safety of AI models. Amodei also emphasized the importance of a coordinated approach to avoid falling behind other AI developers, particularly China.