{"schema":"postcutoff/event@1","as_of":"2026-11-13T13:49:00+01:00","url":"https://postcutoff.com/e/2019-03-13-sutton-bitter-lesson/","md":"https://postcutoff.com/e/2019-03-13-sutton-bitter-lesson/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2019-03-13-sutton-bitter-lesson","date":"2019-03-13","date_precision":"day","short_title":"Rich Sutton publishes \"The Bitter Lesson\"","deck":"General methods that scale with compute win","takeaway":"On March 13, 2019 reinforcement-learning pioneer Rich Sutton published the short essay \"The Bitter Lesson\".","category":"research","category_label":"Research","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Rich Sutton: The Bitter Lesson","url":"http://www.incompleteideas.net/IncIdeas/BitterLesson.html","type":"official","group":"primary","domain":"incompleteideas.net"}],"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["University of Alberta","DeepMind"],"title":"Rich Sutton publishes \"The Bitter Lesson\": general methods that scale with compute win","summary":"On March 13, 2019 reinforcement-learning pioneer Rich Sutton published the short essay \"The Bitter Lesson\". It argues that the biggest lesson of 70 years of AI research is that general methods leveraging computation (search and learning) ultimately beat approaches that build in human knowledge, 'and by a large margin'. It became the canonical statement of the scaling philosophy behind modern frontier AI.","key_facts":["Published March 13, 2019 on incompleteideas.net","Core claim: 'general methods that leverage computation are ultimately the most effective, and by a large margin', driven by the falling cost of computation (a generalization of Moore's law)","Examples: computer chess and Go (search), speech recognition, computer vision","Conclusion: build in 'only the meta-methods that can find and capture this arbitrary complexity', not our own discoveries"],"key_numbers":[],"tags":["essay","scaling","compute","reinforcement-learning"],"science":null,"body_md":"## What happened\n\nIn about 1,100 words Sutton argued that researchers keep trying to build human knowledge into AI systems, which helps in the short term, but that approaches which scale with computation, such as search and learning, eventually win every time, which is 'bitter' for the researchers involved.\n\n## Why it matters\n\nThe essay is widely cited as the philosophical basis of the scaling era, from GPT-3 and the scaling-laws papers to today's compute-heavy frontier training and the RSI debates of 2026, in which lab leaders such as Jakub Pachocki describe progress as driven mainly by compute.","disputed":[],"related":[{"id":"2020-01-23-scaling-laws","url":"https://postcutoff.com/e/2020-01-23-scaling-laws/","date":"2020-01-23","date_precision":"day","short_title":"OpenAI publishes 'Scaling Laws for Neural Language Models'","deck":null,"takeaway":"Scaling laws became the strategic basis for the trillion-dollar compute build-out of the 2020s.","category":"research","category_label":"Research","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":2,"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["OpenAI"]},{"id":"2017-11-11-karpathy-software-2-0","url":"https://postcutoff.com/e/2017-11-11-karpathy-software-2-0/","date":"2017-11-11","date_precision":"day","short_title":"Andrej Karpathy's essay \"Software 2.0\"","deck":"Neural networks as a new way to write software","takeaway":"It gave the deep-learning era its best-known software-engineering metaphor, and Karpathy's later talks ('Software 3.0', where natural-language prompts program LLMs) and his 2025 'vibe coding' post build directly on it.","category":"research","category_label":"Research","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":2,"official":2,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Tesla"]}],"people":[{"id":"jakub-pachocki","name":"Jakub Pachocki","url":"https://postcutoff.com/person/jakub-pachocki/"},{"id":"richard-sutton","name":"Richard Sutton","url":"https://postcutoff.com/person/richard-sutton/"}],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-09-29","type":"filed","text":"Created (primary source checked)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":null,"in_training_data":true},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":null,"in_training_data":true},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":null,"in_training_data":true},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":null,"in_training_data":true}],"short_url":"https://postcutoff.com/s/rich-sutton-bitter-lesson"}