Urgent.News

What's breaking now, across thousands of outlets.

AI

Anthropic's Amodei says China presents 'toughest dilemma' for his proposed AI slowdown

OpenAI CEO Sam Altman, Demis Hassabis, the chair of Google DeepMind, and Elon Musk have all welcomed Amodei's proposal.

Dario Amodei, the CEO of AI company Anthropic, has called for a slowdown in the development of artificial intelligence models and greater oversight of their creation. In an online essay titled "We Must Pace the Frontier," Amodei argued that while AI development is not the issue, the associated risks are serious. He urged companies and governments to take time to address these risks. Amodei's proposal includes independent monitoring of AI models during development, industry-wide regulation, and global regulation.

The idea resonated with other AI industry leaders, including OpenAI CEO Sam Altman and Tesla CEO Elon Musk, both of whom agreed with Amodei's stance. However, these calls for caution come amid growing concerns about the potential risks of AI technology. An ex-Anthropic researcher told the BBC that a lack of slowing down could lead to humanity's extinction in the near future. This has sparked a debate about the appropriate pace of AI development and the need for safety measures.

While Amodei has received support from some industry leaders, others, such as former President Donald Trump, have dismissed these concerns. Trump argued that not keeping pace with AI development could put the US at a disadvantage. However, safety has emerged as a key issue in the rivalry between Anthropic and OpenAI. Amodei, who previously worked at OpenAI, co-founded Anthropic in 2021 with the goal of building safer and more trustworthy AI models.

Amodei acknowledged that regulation may not keep pace with the rapid advancement of AI technology. Instead, he called for voluntary collaboration among companies to establish standards and for third-party evaluators to ensure the safety of AI models. Amodei also emphasized the importance of a coordinated approach to avoid falling behind other AI developers, particularly China.

Written by urgent.news from BBC Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at cnbc.com →

More in AI

AI : 'We need to take the risk seriously and have more coordination'

This week's debate over AI has put the spotlight on how seriously we should take the technology's growing risks. On FRANCE 24, University of Salford Chair in Science Communication and Future Media, Andy Miah, argued that while AI poses real challenges requiring closer coordination between companies and governments, there is no existential…

More from Sunday 13 September →