--- id: "2025-10-22-agents4science-conference" url: "https://postcutoff.com/e/2025-10-22-agents4science-conference/" as_of: "2026-11-13T13:49:00+01:00" date: "2025-10-22" date_precision: day category: science importance: 3 confidence: high status: [Result confirmed] verification: Preprint only sources: 4 editor: human editor human_review: null version: "2026-10-07" --- As of: 2026-11-13 13:49 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2025-10-22-agents4science-conference/ # Agents4Science 2025, the first conference where AI must be first author and reviewer Full title: Agents4Science 2025: first conference where AI must be first author and reviewer Agents4Science 2025 (22 Oct 2025, virtual) required AI systems as first authors and used GPT-5, Gemini 2.5 and Claude Sonnet 4 as reviewers: 315 submissions, 253 reviewed, 48 accepted, making AI-authored science an explicit experiment. ## Key facts - 315 submissions; 62 desk-rejected; 253 reviewed by three LLM reviewers (GPT-5, Gemini 2.5, Claude Sonnet 4) - Top 79 also got human expert review; 48 papers accepted - Organised by James Zou's group at Stanford with Together AI - Secondary reports say only a handful of accepted papers were fully AI-generated (unverified figure) ## What happened Stanford researchers ran a conference in which AI agents had to be listed as first authors and LLMs did first-round reviewing, to study openly what AI-driven research looks like. ## Why it matters It made AI authorship an explicit, measurable experiment rather than a hidden practice, and produced data on the strengths and failure modes of AI reviewers. ## Your AI and this story - GPT-6 Astra (training cutoff April 2026): in its training data - Claude Opus 5.5 (training cutoff June 2026): in its training data - Gemini 4 Hydrogen (training cutoff March 2026): in its training data - Grok 4.7 (training cutoff May 2026): in its training data ## Sources 1. [Agents4Science analysis paper (arXiv 2511.15534)](https://arxiv.org/abs/2511.15534) (arxiv.org, paper) 2. [Agents4Science accepted papers](https://agents4science.stanford.edu/accepted-papers.html) (agents4science.stanford.edu, official) 3. [Nature news on the AI-authored conference](https://www.nature.com/articles/d41586-025-03363-3) (nature.com, press) 4. [Science News: a science conference tests AI agents](https://www.sciencenews.org/article/science-conference-test-ai-agents) (sciencenews.org, press) ## Changes - 2026-09-29 (filed): Created ## Related - 2025-03-12: [Sakana's AI Scientist-v2 writes the first fully AI-generated paper to pass peer review](https://postcutoff.com/e/2025-03-12-sakana-ai-scientist-v2-peer-review/index.md)