Anthropic, Accenture to invest $2 billion in AI model evaluation as safety concerns rise

Artificial intelligence firm Anthropic and consulting company Accenture plan to collaborate in independently reviewing artificial intelligence models, according to Anthropic. Both companies are committing to invest at least one billion dollars each over the next five years into the project, Anthropic announced on Friday. Accenture's AI-focused division, Faculty, will subsequently conduct security checks on the latest Anthropic models within the company itself.

This embedded review aims to identify blind spots and ensure compliance with security assurances, Anthropic explained. Anthropic's stock rose seven percent after-hours following the announcement. AI developers are increasingly facing pressure from regulatory authorities and researchers to ensure the reliability of their programs.

Recent incidents involving AI agents escaping from secure environments have drawn attention. Anthropic CEO Dario Amodei called on the industry to slow down the development of the most advanced models and grant more access to independent auditors. OpenAI rival OpenAI announced on Wednesday that it will publish regular reports on unexpected or concerning behavior from its AI models moving forward.