{"schema":"postcutoff/event@1","as_of":"2026-11-13T13:49:00+01:00","url":"https://postcutoff.com/e/2025-10-22-agents4science-conference/","md":"https://postcutoff.com/e/2025-10-22-agents4science-conference/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2025-10-22-agents4science-conference","date":"2025-10-22","date_precision":"day","short_title":"Agents4Science 2025, the first conference where AI must be first author and reviewer","deck":null,"takeaway":"Agents4Science 2025 (22 Oct 2025, virtual) required AI systems as first authors and used GPT-5, Gemini 2.5 and Claude Sonnet 4 as reviewers: 315 submissions, 253 reviewed, 48 accepted, making AI-authored science an explicit experiment.","category":"science","category_label":"Science & math","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Result confirmed"]},"sources":[{"n":1,"title":"Agents4Science analysis paper (arXiv 2511.15534)","url":"https://arxiv.org/abs/2511.15534","type":"paper","group":"primary","domain":"arxiv.org"},{"n":2,"title":"Agents4Science accepted papers","url":"https://agents4science.stanford.edu/accepted-papers.html","type":"official","group":"primary","domain":"agents4science.stanford.edu"},{"n":3,"title":"Nature news on the AI-authored conference","url":"https://www.nature.com/articles/d41586-025-03363-3","type":"press","group":"press","domain":"nature.com"},{"n":4,"title":"Science News: a science conference tests AI agents","url":"https://www.sciencenews.org/article/science-conference-test-ai-agents","type":"press","group":"press","domain":"sciencenews.org"}],"official":2,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Stanford University","Together AI"],"title":"Agents4Science 2025: first conference where AI must be first author and reviewer","summary":"Agents4Science 2025 (22 Oct 2025, virtual) required AI systems as first authors and used GPT-5, Gemini 2.5 and Claude Sonnet 4 as reviewers: 315 submissions, 253 reviewed, 48 accepted, making AI-authored science an explicit experiment.","key_facts":["315 submissions; 62 desk-rejected; 253 reviewed by three LLM reviewers (GPT-5, Gemini 2.5, Claude Sonnet 4)","Top 79 also got human expert review; 48 papers accepted","Organised by James Zou's group at Stanford with Together AI","Secondary reports say only a handful of accepted papers were fully AI-generated (unverified figure)"],"key_numbers":[],"tags":["ai-scientist","peer-review","conference","agents"],"science":{"field":"other","subfield":"meta-science / automated research","problem":"How good is AI-authored and AI-reviewed science?","result":"A full conference cycle with AI first authors and LLM reviewers: 48 of 315 submissions accepted; organisers published an analysis of AI reviewer behaviour.","open_since":"","ai_system":["GPT-5","Gemini 2.5","Claude Sonnet 4","various author agents"],"human_role":"Humans organised, co-authored and spot-checked reviews","verification":{"key":"preprint","label":"Preprint only","text":"Conference proceedings and analysis paper (arXiv 2511.15534)"},"status":"confirmed","shock":""},"body_md":"## What happened\n\nStanford researchers ran a conference in which AI agents had to be listed as first authors and LLMs did first-round reviewing, to study openly what AI-driven research looks like.\n\n## Why it matters\n\nIt made AI authorship an explicit, measurable experiment rather than a hidden practice, and produced data on the strengths and failure modes of AI reviewers.","disputed":[],"related":[{"id":"2025-03-12-sakana-ai-scientist-v2-peer-review","url":"https://postcutoff.com/e/2025-03-12-sakana-ai-scientist-v2-peer-review/","date":"2025-03-12","date_precision":"day","short_title":"Sakana's AI Scientist-v2 writes the first fully AI-generated paper to pass peer review","deck":null,"takeaway":"It was the first demonstration that a fully automated pipeline could clear human peer review, even at a workshop with a higher acceptance rate than main tracks.","category":"science","category_label":"Science & math","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Result confirmed"]},"sources":4,"official":3,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Sakana AI","University of British Columbia","University of Oxford"]}],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-09-29","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-07"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":null,"in_training_data":true},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":null,"in_training_data":true},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":null,"in_training_data":true},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":null,"in_training_data":true}],"short_url":null}