ModelBrief · Gemini 4 Carbon · Topic Page
Last updated Nov 13, 2026

Gemini 4 Carbon Benchmarks, Fully Mapped: Google's 17-Test Table, AA 60 and LMArena 1526

Published Nov 13, 2026 · Last updated Nov 13, 2026

Search "Gemini 4 Carbon benchmark" and you will find plenty of scores that seem to contradict each other — first in 15 of 17 on Google's table, 60 on the AA index, 1526 on LMArena, and yet "beaten by Fable 5.2". All of these can be true at once; the trick is knowing who ran each test, against whom, and on which version. Here is every verifiable score, mapped. The summary up front: Carbon is a top-tier model, but not the leaderboard leader; its real advantages are long context, security and cost per task — not the absolute peak of general intelligence.

Google's official 17-test table (Oct 28, 2026)

Published with the announcement: Carbon first in 15 of 17, losing only two:

TestCarbonArgonGPT-6 AstraOpus 5.5Fable 5.1
AA Index v5.05950575849
Vals Index v2.270.4%69.2%65.0%70.2%—
SWE-sweep9.6%4.3%9.5%3.6%2.9%
FrontierSWE 261.2%55.0%65.5%62.3%56.3%
Terminal-Bench 4.0 (AA)65.2%57.1%59.1%59.6%52.0%
Agents' Last Exam v1.177.4%69.0%73.1%71.6%—
OSWorld-2.1 (offline)81.5%74.7%80.9%87.2%76.8%
AutomationBench (Zapier)53.9%51.3%41.4%42.5%31.4%
Vending-Bench 2 (USD balance)16,48413,71815,5159,2355,422
Chartography72.5%71.6%71.0%66.3%46.2%
Blueprint-Bench 258.6%54.4%49.7%51.2%41.9%
GraphWalks 256K–1M96.2%84.2%71.8%66.8%65.0%
RiemannBench80.0%76.0%72.0%69.6%65.6%
Terminal-Bench-Science 0.1 (AA)64.8%52.9%63.3%59.0%43.3%
CWE-bench71.0%68.0%68.0%67.0%58.0%
ExploitGym54.8%42.0%42.4%34.5%—
SEC-bench Pro88.2%83.4%85.4%——

Two results stand out: GraphWalks 256K–1M at 96.2% is the largest lead in the whole table (next best Argon at 84.2%), backing Carbon's ultra-long-context positioning; SEC-bench Pro at 88.2% and ExploitGym at 54.8% support its cybersecurity pitch. But the table has three methodology problems: Google calculated several scores itself (SWE-sweep, Agents' Last Exam, OSWorld, GraphWalks, ExploitGym, SEC-bench Pro); security tests ran inside Antigravity offline with safeguards disabled; and rival figures come from their own reports, not the same run. Small gaps like AA 59/58/57 or Vals 70.4/70.2 are effectively ties. Most importantly, the table compares against the previous-generation Fable 5.1 — Fable 5.2 didn't exist yet when it was published.

The AA index: 60, two days at #1

The Artificial Analysis Intelligence Index is the most-watched independent composite, and the timeline matters: at the Oct 28 announcement Google cited the v5.0 score of 59 as #1; on Nov 7 the index updated to v5.0.1 and Carbon (High) topped it at 60.0, with Opus 5.5 at 59 and Astra at 57; on Nov 9 Fable 5.2 shipped and passed it at 64.6 (rounded to 65). As of Nov 12, Carbon at 60.0 sits behind Fable 5.2. By level: Low 54, Medium 58.3, High 60. Carbon tops 4 of the 9 sub-evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience and AutomationBench-AA. One caution on rank: different counting methods (by model vs by 122 configurations) place Carbon anywhere from 2nd to 4th, so this site prints scores and the models ahead and behind, not a single rank.

Other independent measurements

LMArena Text: Carbon (High) 1526 preliminary, #1 (Nov 6–7, ~4,483 votes), previously 1528 (Nov 3–5); #2 Argon (High) at 1523, overlapping within margins. WebDev Arena: #4 at 1768 elo. AA-Omniscience v1.1 (hallucination and knowledge reliability): Carbon (high) net score 54, #1, with Opus 5.5 at 48; accuracy 58% (Argon 48%), but a hallucination rate of 11% versus Argon's 4% — the lowest hallucination rate belongs to Argon. CursorBench 4.0: #1 (60.4% at high effort). Perplexity WANDR and Zapier AutomationBench: both #1, at less than half the cost per task of the next-best external model (Google's claim). MKA, the Multimodal Knowledge Agent benchmark developed by Google with AA: Carbon #2, at under one-sixth the average cost per task of the top scorer. Coding Agent Index (AA): Carbon 59 vs Claude Code + Opus 5.5 at 62 — one of the few independent boards where Carbon clearly trails. FrontierSWE v2: Fable 5.2 69.9%, Carbon 61.2%.

Safety and honesty: Carbon's hardest numbers

If Carbon is merely "one of the top tier" on general intelligence boards, its safety and honesty metrics lead more convincingly (all Google-reported, not yet independently replicated): 99% of attack trajectories blocked in simulated cyberattack testing, with a 0.8% per-attempt breach rate (Argon 3.1%); Gray Swan automated cyberattack query success 2.17% (Argon 9.86%); zero new universal jailbreaks in 132 hours / 13,000+ requests at Trajectory Labs; 0% prompt-injection attack success on the Gray Swan IPI benchmark (a first); 92% pass on the agentic honesty benchmark (Argon 70%); and in the Terminal-Bench 4.0 cheating audit, cheating attempts fell from 3.6% to 0.4% and successful cheating from 2.4% to 0%.

Our take: Carbon's scores need three layers of reading: the official table is bright but self-measured; the independent composites (AA 60, LMArena 1526) confirm top-tier status, but #1 now belongs to Fable 5.2; and safety, honesty, long context and cost per task are the four dimensions where Carbon genuinely differentiates. You buy it not because it is "the strongest", but because it is the steadiest and cheapest on the dimensions that matter for long, hard, verifiable work.

Reference source: this article is an original rewrite produced by this site; facts and figures were checked against Quantslant's full official score table and the Artificial Analysis leaderboard (Nov 11–12, 2026)

← Back to the Gemini 4 Carbon topic page