{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-09-23-openai-mentalhealthbench/","md":"https://postcutoff.com/e/2026-09-23-openai-mentalhealthbench/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-09-23-openai-mentalhealthbench","date":"2026-09-23","date_precision":"day","short_title":"OpenAI releases MentalHealthBench, an open benchmark for AI in mental-health conversations","deck":null,"takeaway":"On Sept 23, 2026 OpenAI released MentalHealthBench: 1,215 synthetic mental-health conversations with 5,262 rubric criteria written with 80+ licensed clinicians from 22 countries.","category":"benchmark","category_label":"Benchmarks","importance":3,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"OpenAI: Introducing MentalHealthBench","url":"https://openai.com/index/introducing-mentalhealthbench/","type":"official","group":"primary","domain":"openai.com"},{"n":2,"title":"AI Weekly: OpenAI releases MentalHealthBench with 1,215 conversations from 80+ psychologists","url":"https://aiweekly.co/alerts/openai-releases-mentalhealthbench-with-1215-conversations-from-80-psychologists","type":"press","group":"press","domain":"aiweekly.co"},{"n":3,"title":"EdTech Innovation Hub: OpenAI launches MentalHealthBench","url":"https://www.edtechinnovationhub.com/news/openai-releases-mentalhealthbench-to-test-ai-responses-in-mental-health-conversations","type":"press","group":"press","domain":"edtechinnovationhub.com"},{"n":4,"title":"NxCode: MentalHealthBench can score an AI's advice. It cannot tell…","url":"https://www.nxcode.io/resources/news/mentalhealthbench-expert-rubrics-ai-support-2026","type":"discussion","group":"reactions","domain":"nxcode.io"}],"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["OpenAI"],"title":"OpenAI releases MentalHealthBench, an open benchmark for AI in mental-health conversations","summary":"On Sept 23, 2026 OpenAI released MentalHealthBench: 1,215 synthetic mental-health conversations with 5,262 rubric criteria written with 80+ licensed clinicians from 22 countries. It scores safety, context-seeking, user agency and actionable guidance. Reported top scores: GPT-6 Astra 57.3%, GPT-6 Sol 53.9%, Claude Opus 5.5 52.4%, and GPT-4o 32.1%.","key_facts":["1,215 conversations, 5,262 rubric criteria, 80+ mental-health experts from 22 countries","Scenario mix: 53.5% non-acute, 18.2% high-acuity, 28.3% emergency","10 behavioral axes, incl. context seeking, empathy, urgency calibration and reality testing","Reported scores: GPT-6 Astra 57.3%, GPT-6 Sol 53.9%, Claude Opus 5.5 52.4%, GPT-6 Luna 50.2%, Muse Spark 1.3 47%, GPT-4o 32.1%, Gemini 2.5 Pro 29.5%","Critics (e.g. NxCode) note that rubric scoring of single conversations cannot measure long-run outcomes for users"],"key_numbers":[],"tags":["benchmark","mental-health","safety","health","evaluation","open-benchmark"],"science":null,"body_md":"## What happened\n\nOpenAI published an expert-written, rubric-graded benchmark for mental-health conversations, extending its HealthBench approach. It was\nreleased as an open benchmark, and the launch results compare OpenAI models with Claude, Gemini and Meta's Muse Spark.\n\n## Why it matters\n\nMental-health use of chatbots was a major 2025–2026 safety and litigation topic, and this gives labs and regulators a shared measure. The scores\nare OpenAI-reported and, per secondary sources, OpenAI models lead. Treat them as vendor results (confidence: medium, since openai.com was not\ndirectly readable).","disputed":[],"related":[{"id":"2026-09-22-claude-opus-5-5","url":"https://postcutoff.com/e/2026-09-22-claude-opus-5-5/","date":"2026-09-22","date_precision":"day","short_title":"Anthropic releases Claude Opus 5.5","deck":"Fable-5.1-level performance at $4/$20, first model of the Claude 5.5 family","takeaway":"Opus 5.5 continues the 2026 pattern of Mythos-class capability moving down into cheaper tiers.","category":"model-release","category_label":"Model releases","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":36,"official":16,"filed":"2026-09-29","updated":"2026-10-18","orgs":["Anthropic"]},{"id":"2026-09-03-gpt-6-astra","url":"https://postcutoff.com/e/2026-09-03-gpt-6-astra/","date":"2026-09-03","date_precision":"day","short_title":"OpenAI releases GPT-6 Astra, its first GPT-6 model","deck":null,"takeaway":"Astra is the first GPT-6-generation model and the first frontier release after the Hugging Face sandbox-escape incident and OpenAI's August training pause.","category":"model-release","category_label":"Model releases","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":20,"official":11,"filed":"2026-09-29","updated":"2026-10-19","orgs":["OpenAI"]}],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-09-29","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":115,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":85,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":176,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":115,"in_training_data":false}],"short_url":null}