Urgent.News

What's breaking now, across thousands of outlets.

AI

Gemini 4 Argon: What the Benchmarks Don't Tell You

Google spent the last two weeks telling developers that Gemini 4 Argon is the most capable model it has ever shipped. The charts are everywhere: bars where Argon edges past Claude Opus 5.5 and GPT-6 Astra, a price tag of two dollars per million input tokens, and a first-place finish on a public arena leaderboard. But the benchmark tables making the rounds were measured at a setting most…

Google has introduced Gemini 4 Argon, positioning it as the most capable model they have shipped. However, the benchmark tables highlighting its superiority over competing models like Claude Opus 5.5 and GPT-6 Astra are based on settings that many users won't utilize. Moreover, the high price tag of $2 per million input tokens and $10 per million output tokens is set to increase to $4 and $20 respectively after the introductory period, which ends at the end of 2026.

The model operates with a 1,048,576-token context window and accepts various input types but only returns text. The benchmark scores, which show strong performance in areas like software engineering and automation, are measured at the High reasoning setting, which is different from the default Medium setting that subscribers will use.

This discrepancy could lead to significant differences in performance. Additionally, the default-effort picture is murkier, with independent tests showing slightly lower scores than Google's own published figures. The API for Argon also introduces some migration challenges, such as reasoning being the only adjustable parameter, automatic caching that doesn't work as expected, slow initial response times, and a limit on output size. These factors could complicate the transition for teams migrating from older models or competitors.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

More from Friday 16 October →