Anthropic tells California governor courts should be able to block risky AI models

California Governor Gavin Newsom has received a letter from Anthropic, an AI company, recommending that courts have the authority to block high-risk AI models, as reported by Reuters on October 28. The letter, sent on October 15, reflects Anthropic's previous policy proposals and echoes concerns over the potential dangers posed by AI systems.

The company has faced government restrictions in the past, including an order from the Trump administration in June to limit access to its cyber-capable Mythos 5 and Fable 5 models due to national security concerns, which was later lifted by the US Commerce Department. Anthropic contends that government officials should have the power to request court orders to halt the release of AI models deemed a serious risk to the public. The California governor's office has not yet commented on the matter.