--- id: "2026-10-27-artificial-analysis-intelligence-index-v5" url: "https://postcutoff.com/e/2026-10-27-artificial-analysis-intelligence-index-v5/" as_of: "2026-11-19T22:11:00+01:00" date: "2026-10-27" date_precision: day category: benchmark importance: 3 confidence: high status: [Confirmed] sources: 4 editor: human editor human_review: null version: "2026-10-29" --- As of: 2026-11-19 22:11 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-10-27-artificial-analysis-intelligence-index-v5/ # Artificial Analysis launches Intelligence Index v5 Full title: Artificial Analysis launches Intelligence Index v5: 60% private tests, FrontierCode 2.0 and Terminal-Bench-Science added; open-weights gap widens to 12 points On Oct 27, 2026 Artificial Analysis replaced its widely cited Intelligence Index v4 with v5, its biggest change since January: nine evaluations in four equal groups (knowledge work, coding, science, general), 60% of them on private or held-out test sets. At launch Claude Opus 5.5 (max) led at 58, ahead of GPT-6 Astra (57) and GPT-6.1 Sol (55); the best open-weights score fell to 12 points behind (Kimi K3.1 Pro, 46, weights unreleased). A day later Gemini 4 Carbon took first place at 59. AA also launched a Progress Index v1 that puts models since November 2022 on one scale. ## Key facts - New in v5: FrontierCode 2.0 (Cognition's private benchmark of 132 tasks in real open-source repositories, graded on whether a maintainer would merge the change; launched the same day) and Terminal-Bench-Science (70 agentic research tasks in a terminal). Upgraded: HLE-Diamond (1,000-question refined Humanity's Last Exam), AA-Omniscience v1.1, CritPt v2 private 40-question hard subset. Kept: AA-Briefcase, AutomationBench-AA, GDP.pdf, Terminal-Bench 4.0. Removed: GDPval-AA v2.1, SciCode, AA-LCR v1.1 - Weights: knowledge work 25% (AA-Briefcase 15, AutomationBench-AA 5, GDP.pdf 5); coding 25% (FrontierCode 2.0 15, Terminal-Bench 4.0 10); science 25% (Terminal-Bench-Science 15, CritPt v2 hard 10); general 25% (AA-Omniscience v1.1 15, HLE-Diamond 10) - Launch results (Oct 27): Claude Opus 5.5 (max) 58, GPT-6 Astra (max) 57, GPT-6.1 Sol (max) 55; Gemini 4 Argon (high) 50; Anthropic and OpenAI held the top five. Kimi K3.1 Pro 46 is the top open-weights model (weights not yet released); among released weights DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32, below Claude Haiku 5.5 (max, 36). The open-weights gap grew from 3 points (v4.3) to 12 - Per-benchmark leaders: Opus 5.5 on FrontierCode 2.0 (46%), HLE-Diamond (68%) and AA-Omniscience v1.1 (48); GPT-6 Astra on Terminal-Bench-Science (63%) and CritPt v2 hard (72%); Sonnet 5.5 on AA-Briefcase (1812 Elo); Kimi K3.1 Pro on Terminal-Bench 4.0 (67%); Argon on AutomationBench-AA (78%); Muse Wonder Full on GDP.pdf (33% all-pass) - Cost per index task: GPT-6.1 Terra (max) $0.96 to Claude Fable 5.1 (max) $13.04 among the top ten; Opus 5.5 (max) $10.04, GPT-6 Astra (max) $6.24, GPT-6.1 Sol (max) $1.27. Opus 5.5 scores 35 at low effort and 58 at max (10x the cost); median output tokens per task rose from 35k to 59k - Oct 28: Gemini 4 Carbon (high) entered at 59, #1 of 52 models (see [2026-10-28-gemini-4-carbon](https://postcutoff.com/e/2026-10-28-gemini-4-carbon/index.md)) - Scores are not comparable with v4.x numbers quoted in older entries (Argon 53 on v4, 50 on v5; Kimi K3.1 Pro 55 to 46; GPT-6 Astra 53 to 57) ## What happened Artificial Analysis, whose composite index labs quote in launch posts (Google led its Carbon announcement with it), moved to a harder v5 built mostly on private tests to limit contamination. Several agentic tasks now dominate token use: Terminal-Bench-Science alone accounts for about a third of the output tokens per index task. ## Why it matters Leaderboard positions in late October 2026 shifted because the yardstick changed, not only because models did. The new index puts more weight on long agentic work and private coding tasks, where open-weights models lag most, so the measured open-closed gap quadrupled overnight. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 149 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 119 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 210 days after its cutoff - Grok 4.7 (training cutoff May 2026): 149 days after its cutoff ## Sources 1. [Artificial Analysis: Announcing Artificial Analysis Intelligence Index v5 (Oct 27)](https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5) (artificialanalysis.ai, official) 2. [Artificial Analysis: Intelligence Index methodology](https://artificialanalysis.ai/methodology/intelligence-benchmarking) (artificialanalysis.ai, docs) 3. [Artificial Analysis Progress Index (trends)](https://artificialanalysis.ai/trends) (artificialanalysis.ai, docs) 4. [Artificial Analysis Intelligence Index leaderboard](https://artificialanalysis.ai/evaluations/artificial-analysis-intelligence-index) (artificialanalysis.ai, docs) ## Changes - 2026-10-29 (filed): Created (seen on Techmeme) ## Related - 2026-10-28: [Google announces Gemini 4 Carbon, #1 on the Artificial Analysis Intelligence Index v5 (59), two weeks after Argon; first only for Fairwind cyber defenders](https://postcutoff.com/e/2026-10-28-gemini-4-carbon/index.md) - 2026-10-26: [OpenAI releases GPT-6.1 Terra, a cheaper mid-size model for computer use](https://postcutoff.com/e/2026-10-26-gpt-6-1-terra/index.md) - 2026-10-23: [Moonshot releases Kimi K3.1 Pro](https://postcutoff.com/e/2026-10-23-kimi-k3-1-pro/index.md) - 2026-09-22: [Anthropic releases Claude Opus 5.5](https://postcutoff.com/e/2026-09-22-claude-opus-5-5/index.md) - 2026-09-03: [OpenAI releases GPT-6 Astra, its first GPT-6 model](https://postcutoff.com/e/2026-09-03-gpt-6-astra/index.md)