Post-Cutoff

BenchmarksOpenAI85 days after June 2026

OpenAI releases MentalHealthBench, an open benchmark for AI in mental-health conversations

Partly confirmed

The takeaway

On Sept 23, 2026 OpenAI released MentalHealthBench: 1,215 synthetic mental-health conversations with 5,262 rubric criteria written with 80+ licensed clinicians from 22 countries.

Status
Claim

Partly confirmed

Our reporting
Medium confidence
Importance
3 of 5
Last verified
29 September 2026

Your AI and this story

  • GPT-6.2 Astra115 days after its cutoff
  • Claude Opus 5.585 days after its cutoff
  • Gemini 4 Hydrogen176 days after its cutoff
  • Grok 4.7115 days after its cutoff

None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 85 days before it.

Key facts

  • 1,215 conversations, 5,262 rubric criteria, 80+ mental-health experts from 22 countries
  • Scenario mix: 53.5% non-acute, 18.2% high-acuity, 28.3% emergency
  • 10 behavioral axes, incl. context seeking, empathy, urgency calibration and reality testing
  • Reported scores: GPT-6 Astra 57.3%, GPT-6 Sol 53.9%, Claude Opus 5.5 52.4%, GPT-6 Luna 50.2%, Muse Spark 1.3 47%, GPT-4o 32.1%, Gemini 2.5 Pro 29.5%
  • Critics (e.g. NxCode) note that rubric scoring of single conversations cannot measure long-run outcomes for users

What happened

OpenAI published an expert-written, rubric-graded benchmark for mental-health conversations, extending its HealthBench approach. It was released as an open benchmark, and the launch results compare OpenAI models with Claude, Gemini and Meta’s Muse Spark.

Why it matters

Mental-health use of chatbots was a major 2025–2026 safety and litigation topic, and this gives labs and regulators a shared measure. The scores are OpenAI-reported and, per secondary sources, OpenAI models lead. Treat them as vendor results (confidence: medium, since openai.com was not directly readable).

Sources

4 sources from 4 sites. Numbers match the chips in the text.

4 sources: 1 primary, 2 press, 1 reaction

Primary

  1. OpenAI: Introducing MentalHealthBenchopenai.com, official

Press

  1. AI Weekly: OpenAI releases MentalHealthBench with 1,215 conversations from 80+ psychologistsaiweekly.co, press
  2. EdTech Innovation Hub: OpenAI launches MentalHealthBenchedtechinnovationhub.com, press

Reactions

  1. NxCode: MentalHealthBench can score an AI’s advice. It cannot tell…nxcode.io, discussion

Changes

  • Filed

Status

Claim

Partly confirmed

Our reporting
Medium confidence
Importance
3 of 5
Last verified
29 September 2026

Sources at a glance

4 sources: 1 primary, 2 press, 1 reaction

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
29 September 2026
Human review
None recorded for this entry. What the editor does
Version
Last saved 4 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

Related events

  1. Model releases

    Anthropic releases Claude Opus 5.5

    Confirmed

  2. Model releases

    OpenAI releases GPT-6 Astra, its first GPT-6 model

    Confirmed

The whole topic