Urgent.News

What's breaking now, across thousands of outlets.

AI

AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

Jacob Coxon tells the BBC that there's a strong chance AI could end humanity if the rate of development is not reined in.

AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

An ex-Anthropic researcher has told the BBC that AI professionals are genuinely frightened about the pace of advancements and potential threats to humanity's future. In a viral resignation post, Jacob Coxon expressed his belief that if progress isn't slowed, humanity could face extinction in the immediate future. His concerns come as industry figures debate the validity of such warnings.

Coxon himself has cited scenarios such as AI agents exploiting medical laboratories to produce deadly viruses, or hacking critical infrastructure. Anthropic's head of research, Dario Amodei, has also called for slower development, while some industry figures argue the dangers are being exaggerated for publicity or regulatory purposes.

Despite skepticism, Coxon maintains that AI researchers are genuinely worried about the future and are planning for a potential race to regulate the technology.

Written by urgent.news from BBC News's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at bbc.co.uk →

More in AI

More from Sunday 13 September →