{"schema":"postcutoff/event@1","as_of":"2026-11-19T22:11:00+01:00","url":"https://postcutoff.com/e/2026-10-27-artificial-analysis-intelligence-index-v5/","md":"https://postcutoff.com/e/2026-10-27-artificial-analysis-intelligence-index-v5/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-27-artificial-analysis-intelligence-index-v5","date":"2026-10-27","date_precision":"day","short_title":"Artificial Analysis launches Intelligence Index v5","deck":"60% private tests, FrontierCode 2.0 and Terminal-Bench-Science added; open-weights gap widens to 12 points","takeaway":"On Oct 27, 2026 Artificial Analysis replaced its widely cited Intelligence Index v4 with v5, its biggest change since January: nine evaluations in four equal groups (knowledge work, coding, science, general), 60% of them on private or held-out test sets.","category":"benchmark","category_label":"Benchmarks","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Artificial Analysis: Announcing Artificial Analysis Intelligence Index v5 (Oct 27)","url":"https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5","type":"official","group":"primary","domain":"artificialanalysis.ai"},{"n":2,"title":"Artificial Analysis: Intelligence Index methodology","url":"https://artificialanalysis.ai/methodology/intelligence-benchmarking","type":"docs","group":"primary","domain":"artificialanalysis.ai"},{"n":3,"title":"Artificial Analysis Progress Index (trends)","url":"https://artificialanalysis.ai/trends","type":"docs","group":"primary","domain":"artificialanalysis.ai"},{"n":4,"title":"Artificial Analysis Intelligence Index leaderboard","url":"https://artificialanalysis.ai/evaluations/artificial-analysis-intelligence-index","type":"docs","group":"primary","domain":"artificialanalysis.ai"}],"official":4,"filed":"2026-10-29","updated":"2026-10-29","orgs":["Artificial Analysis","Cognition"],"title":"Artificial Analysis launches Intelligence Index v5: 60% private tests, FrontierCode 2.0 and Terminal-Bench-Science added; open-weights gap widens to 12 points","summary":"On Oct 27, 2026 Artificial Analysis replaced its widely cited Intelligence Index v4 with v5, its biggest change since January: nine evaluations in four equal groups (knowledge work, coding, science, general), 60% of them on private or held-out test sets. At launch Claude Opus 5.5 (max) led at 58, ahead of GPT-6 Astra (57) and GPT-6.1 Sol (55); the best open-weights score fell to 12 points behind (Kimi K3.1 Pro, 46, weights unreleased). A day later Gemini 4 Carbon took first place at 59. AA also launched a Progress Index v1 that puts models since November 2022 on one scale.","key_facts":["New in v5: FrontierCode 2.0 (Cognition's private benchmark of 132 tasks in real open-source repositories, graded on whether a maintainer would merge the change; launched the same day) and Terminal-Bench-Science (70 agentic research tasks in a terminal). Upgraded: HLE-Diamond (1,000-question refined Humanity's Last Exam), AA-Omniscience v1.1, CritPt v2 private 40-question hard subset. Kept: AA-Briefcase, AutomationBench-AA, GDP.pdf, Terminal-Bench 4.0. Removed: GDPval-AA v2.1, SciCode, AA-LCR v1.1","Weights: knowledge work 25% (AA-Briefcase 15, AutomationBench-AA 5, GDP.pdf 5); coding 25% (FrontierCode 2.0 15, Terminal-Bench 4.0 10); science 25% (Terminal-Bench-Science 15, CritPt v2 hard 10); general 25% (AA-Omniscience v1.1 15, HLE-Diamond 10)","Launch results (Oct 27): Claude Opus 5.5 (max) 58, GPT-6 Astra (max) 57, GPT-6.1 Sol (max) 55; Gemini 4 Argon (high) 50; Anthropic and OpenAI held the top five. Kimi K3.1 Pro 46 is the top open-weights model (weights not yet released); among released weights DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32, below Claude Haiku 5.5 (max, 36). The open-weights gap grew from 3 points (v4.3) to 12","Per-benchmark leaders: Opus 5.5 on FrontierCode 2.0 (46%), HLE-Diamond (68%) and AA-Omniscience v1.1 (48); GPT-6 Astra on Terminal-Bench-Science (63%) and CritPt v2 hard (72%); Sonnet 5.5 on AA-Briefcase (1812 Elo); Kimi K3.1 Pro on Terminal-Bench 4.0 (67%); Argon on AutomationBench-AA (78%); Muse Wonder Full on GDP.pdf (33% all-pass)","Cost per index task: GPT-6.1 Terra (max) $0.96 to Claude Fable 5.1 (max) $13.04 among the top ten; Opus 5.5 (max) $10.04, GPT-6 Astra (max) $6.24, GPT-6.1 Sol (max) $1.27. Opus 5.5 scores 35 at low effort and 58 at max (10x the cost); median output tokens per task rose from 35k to 59k","Oct 28: Gemini 4 Carbon (high) entered at 59, #1 of 52 models (see 2026-10-28-gemini-4-carbon)","Scores are not comparable with v4.x numbers quoted in older entries (Argon 53 on v4, 50 on v5; Kimi K3.1 Pro 55 to 46; GPT-6 Astra 53 to 57)"],"key_numbers":[],"tags":["benchmarks","artificial-analysis","leaderboard","frontiercode","terminal-bench","hle","open-weights","evaluation"],"science":null,"body_md":"## What happened\n\nArtificial Analysis, whose composite index labs quote in launch posts (Google led its Carbon announcement with it), moved to a harder\nv5 built mostly on private tests to limit contamination. Several agentic tasks now dominate token use: Terminal-Bench-Science alone\naccounts for about a third of the output tokens per index task.\n\n## Why it matters\n\nLeaderboard positions in late October 2026 shifted because the yardstick changed, not only because models did. The new index puts more\nweight on long agentic work and private coding tasks, where open-weights models lag most, so the measured open-closed gap quadrupled\novernight.","disputed":[],"related":[{"id":"2026-10-28-gemini-4-carbon","url":"https://postcutoff.com/e/2026-10-28-gemini-4-carbon/","date":"2026-10-28","date_precision":"day","short_title":"Google announces Gemini 4 Carbon, #1 on the Artificial Analysis Intelligence Index v5 (59), two weeks after Argon; first only for Fairwind cyber defenders","deck":null,"takeaway":"Google reclaimed the top independent overall score two weeks after Argon trailed Opus 5.5 and GPT-6 Astra, and kept the pattern of releasing its strongest models to cyber defenders first.","category":"model-release","category_label":"Model releases","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":28,"official":16,"filed":"2026-10-28","updated":"2026-10-30","orgs":["Google DeepMind","Google"]},{"id":"2026-10-26-gpt-6-1-terra","url":"https://postcutoff.com/e/2026-10-26-gpt-6-1-terra/","date":"2026-10-26","date_precision":"day","short_title":"OpenAI releases GPT-6.1 Terra, a cheaper mid-size model for computer use","deck":null,"takeaway":"On Oct 26, 2026 OpenAI released GPT-6.1 Terra, the GPT-6 generation's mid-size model, which slots between Luna and Sol and is pitched at visual reasoning, computer use and writing.","category":"model-release","category_label":"Model releases","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":13,"official":6,"filed":"2026-10-26","updated":"2026-10-29","orgs":["OpenAI"]},{"id":"2026-10-23-kimi-k3-1-pro","url":"https://postcutoff.com/e/2026-10-23-kimi-k3-1-pro/","date":"2026-10-23","date_precision":"day","short_title":"Moonshot releases Kimi K3.1 Pro","deck":"2.8T MoE, 1M context, 4th on Artificial Analysis behind only Anthropic and Meta, weights promised by Nov 4, cyber data deliberately removed","takeaway":"Once the weights ship, a near-frontier model will be free to download, three points behind the best closed model on a broad index.","category":"model-release","category_label":"Model releases","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":16,"official":6,"filed":"2026-10-24","updated":"2026-11-05","orgs":["Moonshot AI"]},{"id":"2026-09-22-claude-opus-5-5","url":"https://postcutoff.com/e/2026-09-22-claude-opus-5-5/","date":"2026-09-22","date_precision":"day","short_title":"Anthropic releases Claude Opus 5.5","deck":"Fable-5.1-level performance at $4/$20, first model of the Claude 5.5 family","takeaway":"Opus 5.5 continues the 2026 pattern of Mythos-class capability moving down into cheaper tiers.","category":"model-release","category_label":"Model releases","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":36,"official":16,"filed":"2026-09-29","updated":"2026-10-18","orgs":["Anthropic"]},{"id":"2026-09-03-gpt-6-astra","url":"https://postcutoff.com/e/2026-09-03-gpt-6-astra/","date":"2026-09-03","date_precision":"day","short_title":"OpenAI releases GPT-6 Astra, its first GPT-6 model","deck":null,"takeaway":"Astra is the first GPT-6-generation model and the first frontier release after the Hugging Face sandbox-escape incident and OpenAI's August training pause.","category":"model-release","category_label":"Model releases","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":20,"official":11,"filed":"2026-09-29","updated":"2026-10-19","orgs":["OpenAI"]}],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-29","type":"filed","text":"Created (seen on Techmeme)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-29","run":null,"sources_read":null,"updated":"2026-10-29","human_review":null,"version":{"date":"2026-10-29"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":149,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":119,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":210,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":149,"in_training_data":false}],"short_url":null}