Urgent.News

What's breaking now, across thousands of outlets.

AI

AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

It comes as the AI firm's boss has called for the technology's development to be slowed down, citing "serious" risks.

AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

Jacob Coxon, a former AI researcher at Anthropic, expressed genuine concern for humanity's future due to the rapid advancement of AI technology. In a viral resignation post, he warned that if progress continues at the current rate, humanity might face imminent danger. His concerns align with those of Dario Amodei, Anthropic's head, who advocated for a slowdown in AI development.

Major players in the AI industry, including Sam Altman of OpenAI and Elon Musk of xAI, also support the idea of deceleration and regulation. Former OpenAI researcher Jacob Coxon, who joined Anthropic, acknowledged the seriousness of the risks but emphasized the need for international coordination to avoid a global race. He shared a bleak scenario where a swarm of bots could act like a supercomputer, potentially taking over the internet within six months to a year.

Anthropic has been transparent about both the benefits and risks of AI, stating that they build models with strong safeguards. The company's CEO, Dario Amodei, has called for industry-wide deceleration and regulation, while also acknowledging the potential benefits of AI in solving diseases and improving lives.

Written by urgent.news from BBC Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at bbc.co.uk →

More in AI

Add AI search to existing application

How to add semantic search to an existing app using an embedding model and pgvector TL;DR Adding the most basic form of "AI search" to an existing app is three changes: Add a vector column to the…

More from Sunday 13 September →