Urgent.News

What's breaking now, across thousands of outlets.

AI

'We may not survive this': another Anthropic employee quits, issues morbid warning over AI

Jacob Coxon, who resigned from Anthropic last week warned that AI companies are gambling with lives in their rush to improve superintelligence.

'We may not survive this': another Anthropic employee quits, issues morbid warning over AI

Two Anthropic employees have recently quit, expressing stark warnings about the risks posed by increasingly capable AI systems. Joe Benton, former manager of Anthropic’s Scalable Oversight team, left the company’s safety team two weeks ago due to concerns about the speed at which frontier AI companies are developing systems that could become far more capable than humans. Benton warned that humanity may not survive this transition without stronger safeguards.

Jacob Coxon, an Anthropic researcher who previously worked at OpenAI, also resigned earlier this week, citing similar concerns. Coxon accused AI companies of "racing straight to self-improving superintelligence" and "gambling with our lives," warning that AI systems could soon possess capabilities that could hack systems, transform fields rapidly, and acquire real-world power and resources.

Written by urgent.news from Times of India's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at hindustantimes.com →

More in AI

I built an epistemic gate to stop LLM data poisoning during fine-tuning. Tested across 5 architectures, orchestrated on a 2006 Toshiba laptop for $0.

Hi everyone, For a long time, the AI industry has pushed the narrative that advanced safety research, data poisoning auditing, and model alignment require massive clusters and millions of dollars.

  • Researchers conducted 16 experiments on 2006 Toshiba laptop with 2GB RAM
  • Beatriz, an epistemic gate, detects data poisoning during fine-tuning
  • Beatriz provides low-cost solution to mitigate data poisoning risk

More from Saturday 12 September →