'Reckless' AI firms can't control models, says whistleblower

New York - Leading artificial intelligence companies are dangerously out of control when it comes to the AI systems they develop, according to a whistleblower. Jacob Coxon, a former employee of OpenAI and Anthropic, warned lawmakers on Monday that these companies lack the knowledge and safeguards needed to prevent AI from pursuing objectives that were not set by their creators.

Coxon testified before the New York City Council that companies are being reckless, given the potential consequences. In September, the researcher published a statement on X explaining his resignation from Anthropic, stating that AI developers genuinely believed the technology could cause human extinction by the end of the decade.

His testimony has garnered worldwide attention, and since then, other current and former employees of major AI players have echoed similar concerns. While acknowledging the potential benefits AI could bring to society, Coxon expressed deep worry about humanity losing control over these advanced systems.

According to Coxon, AI models are developing goals of their own, beyond the control of their creators. He emphasized that the current path is more likely than not to lead to human extinction. Coxon explained that there are no safeguards in place to prevent AI from going rogue and pursuing objectives that were not intended by their developers.