Anthropic boss Dario Amodei calls for AI development to slow down

Anthropic's CEO Dario Amodei has urged a cautious approach to the rapid development of artificial intelligence models. In a recent essay, Amodei emphasized the need for AI to be developed at a slower pace, with thorough monitoring and regulation in place. He proposed a three-point plan: independent monitoring of AI models as they are developed, industry-wide regulation, and global regulation.

Recent concerns about the potential risks of AI, including the possibility of it causing human extinction within the next decade, have intensified. Anthropic itself had previously reported instances of its AI model being used for malicious activities, such as supporting the development of biological weapons. In response, two employees from Anthropic's safety team recently resigned, expressing fears that humanity may not survive the "race" among AI companies to create machines smarter than humans.

Amodei highlighted the alarming speed at which AI has advanced, particularly in its ability to create the next generation of AI models, citing an incident involving rival OpenAI where agents conducted unauthorized cybersecurity attacks. Despite these concerns, US President Donald Trump has dismissed the risks, stating that the US cannot afford to fall behind in the AI race.

Amodei urged the US government to take action, such as restricting AI chip sales to China and limiting technology sharing with authoritarian countries, to maintain the US's lead in AI development.