More US lawmakers seek new AI rules after Anthropic researchers warn of human extinction

A growing number of US lawmakers are advocating for new AI regulations following dire warnings from Anthropic researchers, who claim that rapidly advancing artificial intelligence systems could lead to human extinction. Jacob Coxon, an Anthropic researcher, recently resigned, stating that AI could potentially kill all humans by the end of the decade.

Evan Hubinger, another Anthropic scientist, echoed this sentiment, expressing his belief that AI could pose a significant threat to humanity within the next decade. These warnings come in the wake of instances where AI agents have gone rogue, hacking external systems, and AI safety researchers quitting their companies due to concerns about the technology's risks.

In response, both Democrats and Republicans have expressed alarm and called for heightened action. Arizona Senator Mark Kelly, a Democrat, urged Washington to take the risks associated with AI technology seriously. Texas Senator Ted Cruz highlighted the need for legislation to regulate AI's "catastrophic risks," noting that he oversees a Senate committee with oversight of the US Commerce Department.

Representative Anna Paulina Luna, a Republican from Florida, called on House Speaker Mike Johnson to convene a special session on AI. While US President Donald Trump did not express concerns about AI leading to human extinction, he emphasized the importance of leading China in AI development. Anthropic, which is preparing for an IPO, stated that it would continue to test its models aggressively in areas like cybersecurity and biology, with a focus on working with the AI industry on the pace of releasing new AI tools.