--- id: "2026-09-22-hle-diamond" url: "https://postcutoff.com/e/2026-09-22-hle-diamond/" as_of: "2026-11-22T13:32:00+01:00" date: "2026-09-22" date_precision: day category: benchmark importance: 3 confidence: high status: [Confirmed] sources: 3 editor: human editor human_review: null version: "2026-10-04" --- As of: 2026-11-22 13:32 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-09-22-hle-diamond/ # CAIS releases HLE-Diamond, a refined 1,000-question Humanity's Last Exam Full title: CAIS releases HLE-Diamond, a refined 1,000-question Humanity's Last Exam; GPT-6 Astra scores 82.9% with tools Around Sept 22, 2026 the Center for AI Safety released HLE-Diamond, a cleaned 1,000-question subset of Humanity's Last Exam (500 reasoning, 500 knowledge). GPT-6 Astra scored 82.9% with web and code tools (59.9% without), the first HLE-series result above 75–80%. The prediction-market contract on a ≥75% score by end-2026 jumped from 14% to 87%. ## Key facts - HLE-Diamond: 1,000 questions (500 reasoning + 500 knowledge), a refined subset of HLE - Confirmed on lastexam.ai (checked 2026-09-30): GPT-6 Astra 59.9% without tools and 82.9% with tools (web + code) - lastexam.ai no-tools chart (reasoning high): GPT-6 Astra 59.9%, Claude Opus 5.5 54.6%, GPT-6.1 Sol 53.2%, Claude Fable 5.1 50.7%, Gemini 3.8 Flash 33.3%, Claude Sonnet 5.5 33.1%, GPT-6 Sol 32.8%, Muse Spark 1.3 24.6%, Grok 4.7 22.8% - Scale Labs leaderboard (no tools): gpt-6-astra 60.6% ±3.0, claude-opus-5-5 55.0%, claude-fable-5-1 51.3%, claude-opus-5 38.6%, gemini-3.8-flash 34.3%, gpt-6-sol 33.8%, kimi-k3 22.2%, deepseek-v4-pro 13.4% - Previous best on the main HLE reported at about 65% (Claude Fable 5.1) - Kalshi 'HLE ≥75% by end of 2026' market moved from 14% to 87% - HLE-Rolling was updated on Sept 17, 2026 ## What happened CAIS produced a higher-quality core of HLE after criticism that some original questions had wrong or ambiguous answers. The first reported frontier score is far above the main-HLE scores from earlier in 2026. ## Why it matters If confirmed, the benchmark once billed as 'the last exam' is close to saturation within about 20 months of release. The 82.9% with-tools score is confirmed on the CAIS page; without tools the best model is near 60%. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 114 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 84 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 175 days after its cutoff - Grok 4.7 (training cutoff May 2026): 114 days after its cutoff ## Sources 1. [CAIS / lastexam.ai: HLE-Diamond](https://lastexam.ai/blog/hle-diamond) (lastexam.ai, official) 2. [Scale Labs leaderboard: HLE-Diamond](https://labs.scale.com/leaderboard/hle-diamond) (labs.scale.com, docs) 3. [Octagon AI: Humanity's Last Exam market odds](https://www.octagonai.co/news/ai-benchmark-humanity-s-last-exam-market-odds/) (octagonai.co, press) ## Changes - 2026-09-30: Confirmed GPT-6 Astra 82.9% (with tools) and 59.9% (no tools) on lastexam.ai; added full no-tools chart and Scale leaderboard; confidence raised to high - 2026-09-29 (filed): Created ## Related - 2026-09-03: [OpenAI releases GPT-6 Astra, its first GPT-6 model](https://postcutoff.com/e/2026-09-03-gpt-6-astra/index.md)