Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits

An Anthropic safety researcher has stated that there is a greater than 10% chance that AI could kill all humans. This warning comes after a former colleague, Jacob Coxon, quit over safety concerns. Coxon, who had spent three years conducting pretraining research at both Anthropic and OpenAI, announced his resignation on X, expressing concerns that the companies were moving too quickly towards increasingly powerful and potentially uncontrollable AI systems.

According to Coxon, the companies are "racing straight to self-improving superintelligence and gambling with our lives." He also claimed that some people in the industry believe that AI could pose an existential threat to humanity within the next several years, with some even suggesting that it could happen by the end of the decade. Coxon's concerns were based in part on conversations with senior researchers and executives in the AI industry.

Coxon is not the only insider to have warned about the risks of AI advancement. His resignation follows others from OpenAI and Anthropic who have expressed similar concerns about the safety risks associated with AI development. According to CNBC, Coxon's departure and warnings highlight the growing concerns about the potential dangers of AI and the need for more responsible development and deployment of these technologies.

Brief written by urgent.news from CNBC Technology, CNBC World, The Indian Express, Business Insider, Economic Times Tech — 5 reports on this story. Machine-written — may contain errors; check the original before relying on it.