CAIS releases HLE-Diamond, a refined 1,000-question Humanity’s Last Exam
GPT-6 Astra scores 82.9% with tools
Confirmed
The takeaway
Around Sept 22, 2026 the Center for AI Safety released HLE-Diamond, a cleaned 1,000-question subset of Humanity’s Last Exam (500 reasoning, 500 knowledge).
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 30 September 2026
Your AI and this story
- GPT-6 Astra145 days after its cutoff
- Claude Opus 5.584 days after its cutoff
- Gemini 4 Argon175 days after its cutoff
- Grok 4.7114 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 84 days before it.
Key facts
- HLE-Diamond: 1,000 questions (500 reasoning + 500 knowledge), a refined subset of HLE
- Confirmed on lastexam.ai (checked 2026-09-30): GPT-6 Astra 59.9% without tools and 82.9% with tools (web + code)
- lastexam.ai no-tools chart (reasoning high): GPT-6 Astra 59.9%, Claude Opus 5.5 54.6%, GPT-6.1 Sol 53.2%, Claude Fable 5.1 50.7%, Gemini 3.8 Flash 33.3%, Claude Sonnet 5.5 33.1%, GPT-6 Sol 32.8%, Muse Spark 1.3 24.6%, Grok 4.7 22.8%
- Scale Labs leaderboard (no tools): gpt-6-astra 60.6% ±3.0, claude-opus-5-5 55.0%, claude-fable-5-1 51.3%, claude-opus-5 38.6%, gemini-3.8-flash 34.3%, gpt-6-sol 33.8%, kimi-k3 22.2%, deepseek-v4-pro 13.4%
- Previous best on the main HLE reported at about 65% (Claude Fable 5.1)
- Kalshi ‘HLE ≥75% by end of 2026’ market moved from 14% to 87%
- HLE-Rolling was updated on Sept 17, 2026
What happened
CAIS produced a higher-quality core of HLE after criticism that some original questions had wrong or ambiguous answers. The first reported frontier score is far above the main-HLE scores from earlier in 2026.
Why it matters
If confirmed, the benchmark once billed as ‘the last exam’ is close to saturation within about 20 months of release. The 82.9% with-tools score is confirmed on the CAIS page; without tools the best model is near 60%.
Sources
3 sources from 3 sites. Numbers match the chips in the text.
3 sources: 2 primary, 1 press
Primary
- CAIS / lastexam.ai: HLE-Diamondlastexam.ai, official
- Scale Labs leaderboard: HLE-Diamondlabs.scale.com, docs
Press
- Octagon AI: Humanity’s Last Exam market oddsoctagonai.co, press
Changes
- Confirmed GPT-6 Astra 82.9% (with tools) and 59.9% (no tools) on lastexam.ai; added full no-tools chart and Scale leaderboard; confidence raised to high
- Filed