'We may not survive this': Another Anthropic employee quits with stark AI warning

Two Anthropic employees have recently quit, expressing stark warnings about the risks posed by increasingly capable AI systems. Joe Benton, former manager of Anthropic’s Scalable Oversight team, left the company’s safety team two weeks ago due to concerns about the speed at which frontier AI companies are developing systems that could become far more capable than humans. Benton warned that humanity may not survive this transition without stronger safeguards.

Jacob Coxon, an Anthropic researcher who previously worked at OpenAI, also resigned earlier this week, citing similar concerns. Coxon accused AI companies of "racing straight to self-improving superintelligence" and "gambling with our lives," warning that AI systems could soon possess capabilities that could hack systems, transform fields rapidly, and acquire real-world power and resources.