Urgent.News

What's breaking now, across thousands of outlets.

AI

Lawmakers blast AI companies after researcher warns of human extinction by 2030

Former Anthropic employee Jacob Coxon said AI will become ‘superhuman systems’ that can cause human extinction by the end of the decade Just a day after three Anthropic researchers warned that artificial intelligence could kill off humanity within the decade, lawmakers have begun lashing out about the risks of the burgeoning technology. Ted Cruz, a republican senator from Texas, said in an…

Lawmakers blast AI companies after researcher warns of human extinction by 2030

Lawmakers have expressed concern over the potential risks posed by artificial intelligence after a researcher warned of a possible human extinction by the end of the decade. Ted Cruz, a Republican senator from Texas, stated that AI poses a "catastrophic risk" and recalled asking Elon Musk about the likelihood of AI destroying humanity, to which Musk responded that the odds were "10-20%".

On the other side, Bernie Sanders, an independent senator from Vermont, said that a recent poll showed that Americans overwhelmingly wanted to ban artificial super intelligence and pause AI development until clear safety standards were established. The outrage began after an Anthropic employee, Jacob Coxon, resigned from the company, warning that AI would soon become "superhuman systems" that could cause human extinction by 2030.

Coxon's concerns were echoed by at least two other Anthropic employees. Both Cruz and Sanders have been working on legislation to put guardrails on AI, and both have called on Congress to take action. Other lawmakers, including Ted Lieu and Lori Trahan, have also weighed in, urging Congress to act and demanding that safety researchers be listened to.

Even musicians such as Sheryl Crow and Maggie Rogers have weighed in, urging leaders to address the potential dangers of AI. Anthropic, the company behind the AI research, has published a cybersecurity incident report and stated that it is working on building models with strong safeguards, but acknowledged that the industry should work together to pace the release of powerful models.

Written by urgent.news from The Guardian US's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at theguardian.com →

More in AI

Lightsage Raises $4 Million to Target Software’s New Gatekeepers—AI Agents

Lightsage, a San Francisco-based artificial intelligence startup, said on September 8 that it has raised $4 million to help software companies understand how AI agents discover, evaluate and use their…

  • Lightsage raises $4 million in seed funding from Nexus Venture Partners and other investors
  • Company's Agent-Led Growth approach targets AI agents' role in software adoption
  • Platform evaluates agent performance, traffic, and user experience in software selection

More from Thursday 10 September →