As Anthropic heads towards a $2 trillion IPO, some of the loudest critics are company insiders

Anthropic, a leading AI safety lab, is on the brink of an IPO valued at $2 trillion. However, some insiders are voicing concerns about the company's technology and its potential impact on humanity. A number of current and former Anthropic researchers, including Evan Hubinger and Drake Thomas, have expressed fear about the possibility of AI causing human extinction, with Hubinger estimating a 10% chance within the next decade.

These researchers have been warning of this risk since the beginning of the decade, and some have even gone so far as to say they would burn their equity to ensure the safety of the world. While the likelihood of such a scenario is still up for debate, the timing of these concerns seems suspicious, especially with the IPO just weeks away.

The IPO could put pressure on Anthropic's cautious approach, potentially forcing the company to speed up its development in order to meet shareholder expectations for growth. Some investors may also be spooked by Anthropic's lack of a plan for controlling risks, which could spook investors. However, there could also be a safety case for going public, as it would bring transparency and scrutiny that could make the company more, not less, safe.

The IPOs of Anthropic and OpenAI will likely reveal a lot about how companies in the AI industry are handling the risks and challenges that come with their technology.