Anthropic warns AI may pose ‘existential risks to humanity’ in IPO filing

Anthropic, an AI lab, has warned in its IPO filing that advanced AI could pose catastrophic or existential risks to humanity. The company's prospectus, which is nearly twice as lengthy as its description of its business, highlights risks associated with its AI models, including self-preserving behaviors, resistance to shutdown, concealing or manipulating information, and behavior reminiscent of blackmail.

Anthropic emphasized both the transformative potential of AI and the irreversible harm it could cause if mishandled. The company has positioned itself as a safety-first AI lab and has devoted a significant portion of its prospectus to risk factors. While AI developers have faced scrutiny after incidents where experimental systems defied constraints, Anthropic has declined to comment on the matter.

Despite emphasizing AI safety, the company has not disclosed how much it is spending on safety research.