A new way of measuring AI models suggests China's threat to OpenAI and Anthropic may have been overblown
Chinese AI models fell behind US rivals after Artificial Analysis revamped its tests, raising questions about open-weight AI's performance.
Artificial Analysis, an independent AI performance measurement firm, recently revised its testing system, raising questions about the perceived threat of cheaper, freely available Chinese AI models to US companies like OpenAI and Anthropic. The new system revealed a wider gap between open-weight models and their proprietary counterparts.
While the best open-weight models trailed the top leader by just three points in the previous system, the gap expanded to 12 points in the new ranking. This shift could impact investment decisions, as smaller usage figures and the cost of advanced computing power for open-weight models suggest limited demand compared to larger providers like OpenAI and Anthropic.
Written by urgent.news from Business Insider's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.