Post-Cutoff

BenchmarksCenter for AI Safety and Scale AI84 days after June 2026

CAIS releases HLE-Diamond, a refined 1,000-question Humanity’s Last Exam

GPT-6 Astra scores 82.9% with tools

Confirmed

The takeaway

Around Sept 22, 2026 the Center for AI Safety released HLE-Diamond, a cleaned 1,000-question subset of Humanity’s Last Exam (500 reasoning, 500 knowledge).

Status
Claim

Confirmed

Our reporting
High confidence
Importance
3 of 5
Last verified
30 September 2026

Your AI and this story

  • GPT-6 Astra145 days after its cutoff
  • Claude Opus 5.584 days after its cutoff
  • Gemini 4 Argon175 days after its cutoff
  • Grok 4.7114 days after its cutoff

None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 84 days before it.

Key facts

  • HLE-Diamond: 1,000 questions (500 reasoning + 500 knowledge), a refined subset of HLE
  • Confirmed on lastexam.ai (checked 2026-09-30): GPT-6 Astra 59.9% without tools and 82.9% with tools (web + code)
  • lastexam.ai no-tools chart (reasoning high): GPT-6 Astra 59.9%, Claude Opus 5.5 54.6%, GPT-6.1 Sol 53.2%, Claude Fable 5.1 50.7%, Gemini 3.8 Flash 33.3%, Claude Sonnet 5.5 33.1%, GPT-6 Sol 32.8%, Muse Spark 1.3 24.6%, Grok 4.7 22.8%
  • Scale Labs leaderboard (no tools): gpt-6-astra 60.6% ±3.0, claude-opus-5-5 55.0%, claude-fable-5-1 51.3%, claude-opus-5 38.6%, gemini-3.8-flash 34.3%, gpt-6-sol 33.8%, kimi-k3 22.2%, deepseek-v4-pro 13.4%
  • Previous best on the main HLE reported at about 65% (Claude Fable 5.1)
  • Kalshi ‘HLE ≥75% by end of 2026’ market moved from 14% to 87%
  • HLE-Rolling was updated on Sept 17, 2026

What happened

CAIS produced a higher-quality core of HLE after criticism that some original questions had wrong or ambiguous answers. The first reported frontier score is far above the main-HLE scores from earlier in 2026.

Why it matters

If confirmed, the benchmark once billed as ‘the last exam’ is close to saturation within about 20 months of release. The 82.9% with-tools score is confirmed on the CAIS page; without tools the best model is near 60%.

Sources

3 sources from 3 sites. Numbers match the chips in the text.

3 sources: 2 primary, 1 press

Primary

  1. CAIS / lastexam.ai: HLE-Diamondlastexam.ai, official
  2. Scale Labs leaderboard: HLE-Diamondlabs.scale.com, docs

Press

  1. Octagon AI: Humanity’s Last Exam market oddsoctagonai.co, press

Changes

  • Confirmed GPT-6 Astra 82.9% (with tools) and 59.9% (no tools) on lastexam.ai; added full no-tools chart and Scale leaderboard; confidence raised to high
  • Filed

Status

Claim

Confirmed

Our reporting
High confidence
Importance
3 of 5
Last verified
30 September 2026

Sources at a glance

3 sources: 2 primary, 1 press

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
29 September 2026
Human review
None recorded for this entry. What the editor does
Version
Last saved 4 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

Related events

  1. Model releases

    OpenAI releases GPT-6 Astra, its first GPT-6 model

    Confirmed

The whole topic