AI 'kill switch' may need to be mandatory, Anthropic co-founder says

A co-founder of Anthropic, one of the world's largest AI firms, has suggested that a mandatory AI kill switch, which can be checked by a third party, may be necessary. Jack Clark stated that while most labs have their own methods for shutting down AI software in case of danger, systems similar to Anthropic's should eventually be regulated by society.

This comes as concerns grow about the potential for AI to pose a threat to humanity, with executives and staff of AI companies, as well as AI experts, voicing these worries. Anthropic's head, Dario Amodei, has called for a slower pace of AI development and greater monitoring, though he did not provide specifics on how this could be achieved.

The US government has proposed legislation, known as the Kill Switch Act, which would require companies to have a way to shut down problematic AI tools and provide government agencies with the power to demand such shutdowns. However, Trump has dismissed the idea as a hoax, and the UK government has rejected the notion, stating that it would not prevent AI development or misuse.

Despite these differing opinions, some in the AI industry argue that fears surrounding AI's potential to destroy humanity are either overblown or intended to generate publicity. Anthropic, which developed the popular chatbot Claude and has released several advanced AI models, is currently preparing for a potential record-breaking initial public offering.