Hinton's deep belief nets launch the 'deep learning' revival
Hinton, Osindero and Teh showed that deep networks could be trained effectively with greedy layer-wise pretraining, a result widely credited with reviving interest in 'deep learning'.
Key facts
- Paper: 'A Fast Learning Algorithm for Deep Belief Nets', Neural Computation 18(7), July 2006
- Companion Science paper on autoencoders (Hinton & Salakhutdinov, 2006)
- Stacked restricted Boltzmann machines trained one layer at a time
- Research funded in part by CIFAR
What happened
Researchers demonstrated a practical method to train many-layer networks, achieving strong results on MNIST.
Why it matters
It rebranded neural networks as 'deep learning' and set the stage for the GPU-powered breakthroughs of 2009–2012.
Changelog
- 2026-09-29: created
Related events
Sources (2)
id: 2006-07-01-deep-belief-networks · updated 2026-09-29 · open in the interactive timeline