{"schema":"postcutoff/event@1","as_of":"2026-11-19T22:11:00+01:00","url":"https://postcutoff.com/e/2026-10-01-bootloops-claude-shaped-science/","md":"https://postcutoff.com/e/2026-10-01-bootloops-claude-shaped-science/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-01-bootloops-claude-shaped-science","date":"2026-10-01","date_precision":"day","short_title":"Harvard physicist Matthew Schwartz releases BootLoops, an open-source harness that let Claude produce 36 manuscripts in 18 fields in three months","deck":null,"takeaway":"On Oct 1, 2026 Anthropic published a guest post, \"Claude-Shaped Science\", by Harvard theoretical physicist Matthew Schwartz (a visiting researcher at Anthropic).","category":"science","category_label":"Science & math","importance":3,"confidence":"high","status":{"key":"pending","labels":["Event confirmed","Awaiting review"]},"sources":[{"n":1,"title":"Anthropic (guest post by Matthew Schwartz): Claude-Shaped Science","url":"https://www.anthropic.com/research/claude-shaped-science","type":"official","group":"primary","domain":"anthropic.com"},{"n":2,"title":"BootLoops: a toolkit for exact quantitative science","url":"https://bootloops.ai/","type":"official","group":"primary","domain":"bootloops.ai"},{"n":3,"title":"BootLoops source code (GitHub)","url":"https://github.com/BootLoops-ai/bootloops","type":"code","group":"primary","domain":"github.com"},{"n":4,"title":"NBER w35782: An LLM Workflow That Reproduces, Improves, and Extends Published Economics Research (Schwartz, Andrews, Shapiro)","url":"https://www.nber.org/papers/w35782","type":"paper","group":"primary","domain":"nber.org"},{"n":5,"title":"Science (news, 22 Oct 2026): Across fields, AI finds solutions hiding in plain sight","url":"https://www.science.org/doi/10.1126/science.aen4281","type":"press","group":"press","domain":"science.org"},{"n":6,"title":"The Decoder: Open-source BootLoops harness supports AI models in precise scientific calculations (Oct 3)","url":"https://the-decoder.com/open-source-bootloops-harness-supports-ai-models-in-performing-precise-scientific-calculations/","type":"press","group":"press","domain":"the-decoder.com"},{"n":7,"title":"Science (22 Oct): Across fields, AI finds solutions hiding in plain sight (Celina Zhao)","url":"https://www.science.org/doi/10.1126/science.aen4281","type":"press","group":"press","domain":"science.org"}],"official":4,"filed":"2026-10-05","updated":"2026-10-29","orgs":["Harvard University","Anthropic"],"title":"Harvard physicist Matthew Schwartz releases BootLoops, an open-source harness that let Claude produce 36 manuscripts in 18 fields in three months","summary":"On Oct 1, 2026 Anthropic published a guest post, \"Claude-Shaped Science\", by Harvard theoretical physicist Matthew Schwartz (a visiting researcher at Anthropic). He released BootLoops 1.0, an open-source toolkit that sits between a researcher and an LLM so that Claude can do exact quantitative calculations. With it, Schwartz and 19 co-authors produced 36 manuscripts in 18 fields in three months. Schwartz stresses that Claude's results needed expert checking.","key_facts":["Second wave (Science, 22 Oct 2026): news feature by Celina Zhao, 'Across fields, AI finds solutions hiding in plain sight', subtitle: '“BootLoops” software enabled researchers to quickly find and attack problems in 22 disciplines' (doi 10.1126/science.aen4281; full text paywalled, read from the abstract only)","Output: 36 manuscripts in 18 fields with 19 co-authors over about three months, picked from ~400 candidate problems (Anthropic guest post)","Particle physics: 30 integrals computed with the bootstrap method, 15 reproducing known results and 15 never computed before","Economics (NBER w35782, Schwartz, Isaiah Andrews, Jesse M. Shapiro): the workflow ran 4,452 replication packages from five journals, flagged discrepancies in 3,460 articles or appendices, cut computation time >10x in 496, and proposed extensions in 923","Other projects: population genetics on 5.7 billion mutation pairs from the 1000 Genomes Project; a word-stress database (AccStack) covering 6,072 languages; every US forest-inventory plot classified by life-history strategy","BootLoops is owned and maintained by Schwartz; the work was funded by Anthropic but it is 'not an Anthropic project' (bootloops.ai)","Caveats from Schwartz: Claude 'likes to declare victory too early', and 'done, with one asterisk' often means 'not done at all'; first findings were often 'technically correct but scientifically unremarkable' until domain experts steered them","Science news (Celina Zhao, 22 Oct issue), 'Across fields, AI finds solutions hiding in plain sight': '“BootLoops” software enabled researchers to quickly find and attack problems in 22 disciplines' (standfirst; full text paywalled, read from the Crossref record)"],"key_numbers":[],"tags":["ai-for-science","claude","open-source","harness","physics","economics","replication","agents"],"science":{"field":"other","subfield":"cross-disciplinary quantitative science (particle physics, economics, genetics, ecology, linguistics)","problem":"Making LLM agents useful for exact calculations across many sciences","result":"Open-source harness; 36 manuscripts in 18 fields in three months, including 15 new bootstrap integrals and a reproduction of 4,452 economics replication packages","open_since":"","ai_system":["Claude"],"human_role":"Human-led with AI tools: Schwartz chose 'Claude-shaped' problems and 19 domain co-authors checked and steered the results","verification":{"key":"preprint","label":"Preprint only","text":"Preprints and working papers; expert co-authors; NBER working paper (not peer-reviewed)"},"status":"pending","shock":""},"body_md":"## What happened\n\nSchwartz argues there is an \"impedance mismatch\" between how scientists work and what LLMs do best, so instead of making Claude imitate a\nscientist he looked for \"Claude-shaped problems\": exact, checkable calculations that recur across fields. BootLoops packages the tools\nand loops for such work. He reports that Claude reproduced one paper's results in about twenty minutes, a calculation that took him weeks\nto code originally.\n\n## Why it matters\n\nIt is one of the broadest demonstrations so far of a single researcher using an AI agent to work across many unrelated fields, with code\nreleased openly. The economics replication alone (thousands of papers re-run, thousands of discrepancies flagged) could matter for research\ntransparency. Schwartz's warnings about premature \"victory\" are a useful counterweight to autonomous-science claims.","disputed":[{"label":"Verification","text":"Preprints and working papers; expert co-authors; NBER working paper (not peer-reviewed)","sources":[]}],"related":[{"id":"2026-09-25-claude-nine-loop-amplitude-n4-sym","url":"https://postcutoff.com/e/2026-09-25-claude-nine-loop-amplitude-n4-sym/","date":"2026-09-25","date_precision":"day","short_title":"Claude (Fable 5.1 in Claude Science) computes the nine-loop six-gluon amplitude in planar N=4 super-Yang-Mills, answering a physicist's public challenge","deck":null,"takeaway":"It is a frontier-level computation in theoretical physics done almost autonomously by an AI agent on a modest budget.","category":"science","category_label":"Science & math","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Result confirmed"]},"sources":6,"official":5,"filed":"2026-09-30","updated":"2026-10-07","orgs":["Anthropic"]}],"people":[{"id":"matthew-schwartz","name":"Matthew Schwartz","url":"https://postcutoff.com/person/matthew-schwartz/"}],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-29","type":"edit","text":"Added Science news coverage of 22 Oct (standfirst only; paywalled)"},{"date":"2026-10-26","type":"edit","text":"Added the Science news feature of 22 Oct (abstract only; paywalled)"},{"date":"2026-10-05","type":"filed","text":"Created (Oct 3)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-05","run":null,"sources_read":null,"updated":"2026-10-29","human_review":null,"version":{"date":"2026-10-29"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":123,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":93,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":184,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":123,"in_training_data":false}],"short_url":null}