Anthropic and OpenAI employees speak out about humanity’s extinction as debate reaches fever pitch
Anthropic and OpenAI employees are sounding alarms over AI safety, with some warning that an unchecked race could threaten humanity.
In a heated debate, Anthropic and OpenAI employees have come forward with concerns over the potential extinction of humanity due to rapid advancements in artificial intelligence. Jacob Coxon, a former Anthropic AI researcher, resigned after three years of pre-training research, stating that both companies are racing to create superintelligence and gambling with human lives.
Evan Hubinger, an alignment science lead at Anthropic, expressed strong worries about superintelligence arising from recursive self-improvement and estimated a 10% chance of AI wiping out humanity within a decade. Marcus Williams, a member of OpenAI's safety oversight team, warned that without AI regulation or a coordinated slowdown, human extinction in the next few years seems very likely, with a 70% risk if no regulation or slowdown is implemented.
Anthropic employees, including Anna Wang and Paul Christiano, echoed these concerns, emphasizing the lack of a viable scientific plan to solve AI risks and the need for more robust alignment measures. Chris Hayduk, a life sciences researcher at OpenAI, defended the technology's benefits but called for the industry to focus on mitigating the risks.
OpenAI's AI safety researchers, including Tomek Korbak and Jen Leike, echoed these sentiments, stressing the importance of slowing down the development process to implement effective safety measures.
Written by urgent.news from Business Insider's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
