Urgent.News

What's breaking now, across thousands of outlets.

AI

A new way of measuring AI models suggests China's threat to OpenAI and Anthropic may have been overblown

Chinese AI models fell behind US rivals after Artificial Analysis revamped its tests, raising questions about open-weight AI's performance.

Artificial Analysis, an independent AI performance measurement firm, recently revised its testing system, raising questions about the perceived threat of cheaper, freely available Chinese AI models to US companies like OpenAI and Anthropic. The new system revealed a wider gap between open-weight models and their proprietary counterparts.

While the best open-weight models trailed the top leader by just three points in the previous system, the gap expanded to 12 points in the new ranking. This shift could impact investment decisions, as smaller usage figures and the cost of advanced computing power for open-weight models suggest limited demand compared to larger providers like OpenAI and Anthropic.

Written by urgent.news from Business Insider's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at businessinsider.com →

More in AI

How AI Agents Handle Errors and Exceptions

How AI Agents Handle Errors and Exceptions Your agent will fail. The only question is whether it fails safely — or fails silently, then builds a whole chain of wrong actions on top of the first bad…

  • AI agents prone to errors, distinction between safe and silent failures
  • Unique error handling strategies: retries, self-correction, human intervention
  • Critical detection layers: structured tool results, schema validation, tracing

More from Tuesday 3 November →