OpenAI releases MentalHealthBench, an open benchmark for AI in mental-health conversations
Partly confirmed
The takeaway
On Sept 23, 2026 OpenAI released MentalHealthBench: 1,215 synthetic mental-health conversations with 5,262 rubric criteria written with 80+ licensed clinicians from 22 countries.
Status
- Claim
Partly confirmed
- Our reporting
- Medium confidence
- Importance
- 3 of 5
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6.2 Astra115 days after its cutoff
- Claude Opus 5.585 days after its cutoff
- Gemini 4 Hydrogen176 days after its cutoff
- Grok 4.7115 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 85 days before it.
Key facts
- 1,215 conversations, 5,262 rubric criteria, 80+ mental-health experts from 22 countries
- Scenario mix: 53.5% non-acute, 18.2% high-acuity, 28.3% emergency
- 10 behavioral axes, incl. context seeking, empathy, urgency calibration and reality testing
- Reported scores: GPT-6 Astra 57.3%, GPT-6 Sol 53.9%, Claude Opus 5.5 52.4%, GPT-6 Luna 50.2%, Muse Spark 1.3 47%, GPT-4o 32.1%, Gemini 2.5 Pro 29.5%
- Critics (e.g. NxCode) note that rubric scoring of single conversations cannot measure long-run outcomes for users
What happened
OpenAI published an expert-written, rubric-graded benchmark for mental-health conversations, extending its HealthBench approach. It was released as an open benchmark, and the launch results compare OpenAI models with Claude, Gemini and Meta’s Muse Spark.
Why it matters
Mental-health use of chatbots was a major 2025–2026 safety and litigation topic, and this gives labs and regulators a shared measure. The scores are OpenAI-reported and, per secondary sources, OpenAI models lead. Treat them as vendor results (confidence: medium, since openai.com was not directly readable).
Sources
4 sources from 4 sites. Numbers match the chips in the text.
4 sources: 1 primary, 2 press, 1 reaction
Primary
- OpenAI: Introducing MentalHealthBenchopenai.com, official
Press
- AI Weekly: OpenAI releases MentalHealthBench with 1,215 conversations from 80+ psychologistsaiweekly.co, press
- EdTech Innovation Hub: OpenAI launches MentalHealthBenchedtechinnovationhub.com, press
Reactions
- NxCode: MentalHealthBench can score an AI’s advice. It cannot tell…nxcode.io, discussion
Changes
- Filed