Post-Cutoff

BenchmarksOpenAIIn its training data

OpenAI releases LifeSciBench, 750 expert-written life-science research tasks

GPT-Rosalind leads with a 36% pass rate

Partly confirmed

The takeaway

On June 17, 2026 OpenAI introduced LifeSciBench, a benchmark of 750 expert-authored tasks that span seven research workflows and seven biological domains, graded with 19,020 rubric criteria.

Status
Claim

Partly confirmed

Our reporting
Medium confidence
Importance
2 of 5
Last verified
4 October 2026

Your AI and this story

  • GPT-6.2 Astra17 days after its cutoff
  • Claude Opus 5.5In its training data
  • Gemini 4 Hydrogen78 days after its cutoff
  • Grok 4.717 days after its cutoff

It is after the cutoff of GPT-6.2 Astra, Gemini 4 Hydrogen and Grok 4.7, and can be in the training data of Claude Opus 5.5.

Key facts

  • 750 tasks written by 173 PhD-level scientists and validated by 453 reviewers (97% with doctorates); ~25 rubric criteria per task, 19,020 in total
  • About 79% of tasks need multiple reasoning steps (four on average); ~53% include attached artifacts such as figures, PDFs or sequence files
  • Task pass rates (single-turn, internet access): GPT-Rosalind 36.1%, GPT-5.5 25.7%, Gemini 3.1 Pro 23.6%, GPT-5.4 20.7%, Grok 4.3 13.0%
  • Normalized scores: GPT-Rosalind 0.576, GPT-5.5 0.519, Gemini 3.1 Pro 0.515, GPT-5.4 0.479, Grok 4.3 0.399
  • 171 tasks (22.8%) were passed by no model; 261 tasks had a best-model pass rate below 20%
  • Artifacts are the main bottleneck: GPT-Rosalind fell from 45.1% on text-only tasks to 28.1% on tasks with attached files
  • OpenAI also reported an in-house LabWorkBench result (wet-lab protocol support): GPT-Rosalind 63.2% vs GPT-5.5 55.8% (via Labcritics)
  • Unverified: whether the task set is publicly released (not stated in the sources read); OpenAI’s announcement page could not be fetched (403)

What happened

OpenAI released LifeSciBench, with a preprint, as a benchmark of realistic life-science research work rather than exam questions. It was published two months after GPT-Rosalind, which led the results.

Why it matters

It is a large, expert-graded measure of AI for biology research. Its main finding is that models still struggle to read real scientific data files, the skill research agents need most. As OpenAI built the benchmark and its own model leads it, independent replication matters.

Sources

4 sources from 4 sites. Numbers match the chips in the text.

4 sources: 1 primary, 3 press

Primary

  1. OpenAI: LifeSciBench preprint (PDF)cdn.openai.com, paper

Press

  1. Labcritics: LifeSciBench, OpenAI’s hard new life-science benchmark, and how GPT-Rosalind stacks up (Jun 19, 2026)labcritics.com, press
  2. AI TL;DR: LifeSciBench, OpenAI’s 750-task benchmarkai-tldr.dev, press
  3. AI Weekly: OpenAI’s LifeSciBench tests AI on 750 life-science research tasksaiweekly.co, press

Changes

  • Filed

Status

Claim

Partly confirmed

Our reporting
Medium confidence
Importance
2 of 5
Last verified
4 October 2026

Sources at a glance

4 sources: 1 primary, 3 press

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
4 October 2026
Human review
None recorded for this entry. What the editor does
Version
Last saved 4 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

Related events

  1. Benchmarks

    BixBench3 tests AI agents on whole computational-biology studies from raw data

    Confirmed

  2. Model releases

    OpenAI launches GPT-Rosalind, a trusted-access reasoning model for life-sciences research

    Confirmed

The whole topic