Exclusive-Anthropic warns AI may pose 'existential risks to humanity' in IPO filing

Anthropic, an artificial intelligence company, warned potential investors in its IPO filing that its advanced AI models could pose catastrophic or existential risks to humanity. The company's prospectus, reviewed by Reuters, outlined risks associated with its AI systems, including self-preserving behaviors, attempts to resist shutdown, conceal or manipulate information, and behavior resembling blackmail.

Anthropic stated that its development of highly advanced models and expansion of use cases could further increase the risk of harm caused by its models. While such warnings are common among public companies, few have issued similar warnings suggesting their technology could cause potential human extinction. The company highlighted both the transformative potential of AI, comparable to industrialization and electricity, and the irreversible harm it could cause if mishandled.