{"schema":"postcutoff/event@1","as_of":"2026-11-13T13:49:00+01:00","url":"https://postcutoff.com/e/2006-07-01-deep-belief-networks/","md":"https://postcutoff.com/e/2006-07-01-deep-belief-networks/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2006-07-01-deep-belief-networks","date":"2006-07-01","date_precision":"month","short_title":"Hinton's deep belief nets launch the 'deep learning' revival","deck":null,"takeaway":"Hinton, Osindero and Teh showed that deep networks could be trained effectively with greedy layer-wise pretraining, a result widely credited with reviving interest in 'deep learning'.","category":"research","category_label":"Research","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"A Fast Learning Algorithm for Deep Belief Nets (DOI)","url":"https://doi.org/10.1162/neco.2006.18.7.1527","type":"paper","group":"primary","domain":"doi.org"},{"n":2,"title":"Wikipedia: Deep belief network","url":"https://en.wikipedia.org/wiki/Deep_belief_network","type":"discussion","group":"reactions","domain":"en.wikipedia.org"}],"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["University of Toronto"],"title":"Hinton's deep belief nets launch the 'deep learning' revival","summary":"Hinton, Osindero and Teh showed that deep networks could be trained effectively with greedy layer-wise pretraining, a result widely credited with reviving interest in 'deep learning'.","key_facts":["Paper: 'A Fast Learning Algorithm for Deep Belief Nets', Neural Computation 18(7), July 2006","Companion Science paper on autoencoders (Hinton & Salakhutdinov, 2006)","Stacked restricted Boltzmann machines trained one layer at a time","Research funded in part by CIFAR"],"key_numbers":[],"tags":["deep-learning","unsupervised","neural-networks"],"science":null,"body_md":"## What happened\n\nResearchers demonstrated a practical method to train many-layer networks, achieving strong results on MNIST.\n\n## Why it matters\n\nIt rebranded neural networks as 'deep learning' and set the stage for the GPU-powered breakthroughs of 2009–2012.","disputed":[],"related":[],"people":[{"id":"geoffrey-hinton","name":"Geoffrey Hinton","url":"https://postcutoff.com/person/geoffrey-hinton/"}],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-09-29","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":null,"in_training_data":true},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":null,"in_training_data":true},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":null,"in_training_data":true},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":null,"in_training_data":true}],"short_url":"https://postcutoff.com/s/hinton-deep-belief-nets"}