Urgent.News

What's breaking now, across thousands of outlets.

AI

AI researcher whose apocalypse warning went viral outlines his disagreements with Anthropic leadership

"They largely initiated the recent race to RSI, because of a belief in its inevitability," Jacob Coxon said about Anthropic, his former employer.

Jacob Coxon, a former researcher at AI company Anthropic, recently held a question-and-answer session on the social media platform X. During this AMA, Coxon provided insight into his decision to leave Anthropic and expressed his disagreements with the company's leadership.

Coxon emphasized the race to create recursive self-improving AI models (RSI) as a core disagreement with Anthropic's leadership. He believed that Anthropic's pursuit of RSI was based on the false assumption that it was inevitable. According to Coxon, this belief led Anthropic to initiate the recent frenzy surrounding RSI development.

Furthermore, Coxon criticized Anthropic's leadership for being overly paranoid about potential threats from China and the U.S. government. He believed that this paranoia prevented constructive negotiations and hindered the AI industry's progress. Anthropic CEO Dario Amodei, however, has expressed concerns about how other AI companies might approach safety if Anthropic were the lone frontier lab slowing down development.

Coxon also noted that Anthropic's leadership initiated the race to RSI, driven by a belief in its inevitability. He felt that this approach was reckless and gambling with humanity's future. Additionally, he expressed concerns about Anthropic's internal atmosphere, with AI workers worried about the potential consequences of their work turning against humanity.

Written by urgent.news from Business Insider's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Also reported by 1 other outlet

Read the original at businessinsider.com →

More in AI

More from Tuesday 15 September →