{"schema":"postcutoff/event@1","as_of":"2026-11-19T22:11:00+01:00","url":"https://postcutoff.com/e/2026-06-17-openai-lifescibench/","md":"https://postcutoff.com/e/2026-06-17-openai-lifescibench/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-06-17-openai-lifescibench","date":"2026-06-17","date_precision":"day","short_title":"OpenAI releases LifeSciBench, 750 expert-written life-science research tasks","deck":"GPT-Rosalind leads with a 36% pass rate","takeaway":"On June 17, 2026 OpenAI introduced LifeSciBench, a benchmark of 750 expert-authored tasks that span seven research workflows and seven biological domains, graded with 19,020 rubric criteria.","category":"benchmark","category_label":"Benchmarks","importance":2,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":[{"n":1,"title":"OpenAI: LifeSciBench preprint (PDF)","url":"https://cdn.openai.com/pdf/b4299379-0a97-4ffa-8b9b-c3fbb299caa9/lifescibench_preprint.pdf","type":"paper","group":"primary","domain":"cdn.openai.com"},{"n":2,"title":"Labcritics: LifeSciBench, OpenAI's hard new life-science benchmark, and how GPT-Rosalind stacks up (Jun 19, 2026)","url":"https://labcritics.com/blog/2026/06/19/lifescibench-openais-hard-new-life-science-benchmark-and-how-gpt-rosalind-stacks-up/","type":"press","group":"press","domain":"labcritics.com"},{"n":3,"title":"AI TL;DR: LifeSciBench, OpenAI's 750-task benchmark","url":"https://ai-tldr.dev/releases/openai-lifescibench/","type":"press","group":"press","domain":"ai-tldr.dev"},{"n":4,"title":"AI Weekly: OpenAI's LifeSciBench tests AI on 750 life-science research tasks","url":"https://aiweekly.co/alerts/openais-lifescibench-tests-ai-on-750-life-science-research-tasks","type":"press","group":"press","domain":"aiweekly.co"}],"official":1,"filed":"2026-10-04","updated":"2026-10-04","orgs":["OpenAI"],"title":"OpenAI releases LifeSciBench, 750 expert-written life-science research tasks; GPT-Rosalind leads with a 36% pass rate","summary":"On June 17, 2026 OpenAI introduced LifeSciBench, a benchmark of 750 expert-authored tasks that span seven research workflows and seven biological domains, graded with 19,020 rubric criteria. Its life-sciences model GPT-Rosalind scored best but passed only 36.1% of tasks, and 22.8% of tasks were passed by no model, so the benchmark is far from saturated.","key_facts":["750 tasks written by 173 PhD-level scientists and validated by 453 reviewers (97% with doctorates); ~25 rubric criteria per task, 19,020 in total","About 79% of tasks need multiple reasoning steps (four on average); ~53% include attached artifacts such as figures, PDFs or sequence files","Task pass rates (single-turn, internet access): GPT-Rosalind 36.1%, GPT-5.5 25.7%, Gemini 3.1 Pro 23.6%, GPT-5.4 20.7%, Grok 4.3 13.0%","Normalized scores: GPT-Rosalind 0.576, GPT-5.5 0.519, Gemini 3.1 Pro 0.515, GPT-5.4 0.479, Grok 4.3 0.399","171 tasks (22.8%) were passed by no model; 261 tasks had a best-model pass rate below 20%","Artifacts are the main bottleneck: GPT-Rosalind fell from 45.1% on text-only tasks to 28.1% on tasks with attached files","OpenAI also reported an in-house LabWorkBench result (wet-lab protocol support): GPT-Rosalind 63.2% vs GPT-5.5 55.8% (via Labcritics)","Unverified: whether the task set is publicly released (not stated in the sources read); OpenAI's announcement page could not be fetched (403)"],"key_numbers":[],"tags":["benchmark","biology","life-sciences","gpt-rosalind","science-agents","evaluation"],"science":null,"body_md":"## What happened\n\nOpenAI released LifeSciBench, with a preprint, as a benchmark of realistic life-science research work rather than exam questions. It was\npublished two months after GPT-Rosalind, which led the results.\n\n## Why it matters\n\nIt is a large, expert-graded measure of AI for biology research. Its main finding is that models still struggle to read real scientific data files,\nthe skill research agents need most. As OpenAI built the benchmark and its own model leads it, independent replication matters.","disputed":[],"related":[{"id":"2026-08-26-bixbench3-computational-biology-agents","url":"https://postcutoff.com/e/2026-08-26-bixbench3-computational-biology-agents/","date":"2026-08-26","date_precision":"day","short_title":"BixBench3 tests AI agents on whole computational-biology studies from raw data","deck":"Best score 0.48 (GPT-5.6 Sol)","takeaway":"It is an end-to-end test for \"AI scientist\" claims in biology.","category":"benchmark","category_label":"Benchmarks","importance":2,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":5,"official":4,"filed":"2026-10-04","updated":"2026-10-04","orgs":["Edison Scientific"]},{"id":"2026-04-17-openai-gpt-rosalind","url":"https://postcutoff.com/e/2026-04-17-openai-gpt-rosalind/","date":"2026-04-17","date_precision":"day","short_title":"OpenAI launches GPT-Rosalind, a trusted-access reasoning model for life-sciences research","deck":null,"takeaway":"It is part of the 2026 race among frontier labs for AI-for-science products (Anthropic's Claude Science, Google's Gemini for Science).","category":"model-release","category_label":"Model releases","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":10,"official":6,"filed":"2026-09-29","updated":"2026-10-13","orgs":["OpenAI"]}],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-04","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-04","run":null,"sources_read":null,"updated":"2026-10-04","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":17,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":null,"in_training_data":true},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":78,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":17,"in_training_data":false}],"short_url":null}