AI workers publicly quitting ‘help to move the needle’ with safety concerns, experts say

A leading AI researcher has resigned from his position, citing grave safety concerns about the technology, joining a growing number of AI professionals who have left their jobs this year. Jacob Coxon, a 27-year-old Anthropic researcher, announced his departure from the industry altogether, accusing his former employers of "racing straight to self-improving superintelligence and gambling with our lives."

Coxon's warning comes as some researchers within Anthropic express similar fears, with Alignment Science lead Evan Hubinger agreeing that Coxon was "correct" in his assessment. Coxon is not the first AI researcher to leave a frontier AI lab over ethical concerns, with several others doing so in 2024 after losing confidence in their companies' safety approaches.

Anthropic's approach to safety has been a point of debate, with the company facing its own high-profile departures earlier this year. While Coxon's resignation may signal a new phase of concern about AI risks, experts believe it is a "loud signal" that such concerns are growing within the AI industry. Computer scientist Stuart Russell, a professor at UC Berkeley, noted that people are finally taking these issues more seriously, citing recent incidents involving AI models and autonomous agents.

However, safety researcher Chinmayi Sharma cautioned that market dynamics may still push AI research into dangerous territory, despite these resignations and calls for reform.