CONNECT WITH US
Tech

Tech

Gemini 4 Carbon lags just behind Claude in benchmark, but wins in value

9to5Google logo

Published on

Add as a preferred source on Google
Gemini 4 Carbon lags just behind Claude in benchmark, but wins in value

Google’s new frontier model, Gemini 4 Carbon, brings some welcome improvements and while it doesn’t top the charts in a new benchmark, it does provide much more bang for your buck.

SemiAnalysis, an AI research and analysis firm, recently published its new frontier-level benchmark, GDPx which includes numbers for Google’s Gemini 4 Carbon model. The leaderboard includes every major frontier model from the likes of OpenAI, Anthropic, and Meta and details both the score and cost for each model.

The benchmark includes 206 tasks across finance, materials science, cybersecurity, software engineering, legal, biology, and several other domains (topics).

Topping the results is Anthropic’s Claude Opus 5.5, but Google’s Gemini 4 Carbon is very close behind. The difference between the two is relatively minimal, but the cost is the biggest factor to consider here. Where Claude’s cost came out to around $51 per task, Gemini was just over $16 per task. Gemini also beat the next model on the list, GPT-6 Astra, which scored lower while costing more than both at about $54 per task.

The report notes that taking out cybersecurity, biology, and alignment domains shuffles the results. Safety guardrails in Claude and GPT models puts GPT-6 Astra at the top of the list with GPT 6.1 Sol and Claude Sonnet 5.5 outranking Gemini 4 Carbon. SemiAnalysis says that this better aligns with their “subjective impressions” of each model.

As for Google’s existing frontier model, Gemini 4 Argon, it ranks in eighth place on both lists, beating Meta’s Muse Wonder, but below Wonder Full.


Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.