---
id: "1997-11-15-lstm"
url: "https://postcutoff.com/e/1997-11-15-lstm/"
as_of: "2026-11-13T13:49:00+01:00"
date: "1997-11-15"
date_precision: month
category: research
importance: 4
confidence: high
status: [Confirmed]
sources: 2
editor: human editor
human_review: null
version: "2026-10-04"
---

As of: 2026-11-13 13:49 CET.
Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/
Canonical page: https://postcutoff.com/e/1997-11-15-lstm/

# Hochreiter & Schmidhuber introduce Long Short-Term Memory (LSTM)

LSTM introduced gated memory cells that let recurrent neural networks learn long-range dependencies, solving the vanishing-gradient problem that crippled earlier RNNs.

## Key facts
- Published in Neural Computation 9(8), November 1997
- Authors: Sepp Hochreiter and Jürgen Schmidhuber
- Forget gates were added later (Gers et al., 2000)
- Powered speech recognition and machine translation systems in the 2010s

## What happened

The paper proposed a recurrent architecture with a constant-error carousel and multiplicative gates controlling information flow.

## Why it matters

LSTMs dominated sequence modeling (speech, translation, handwriting) until the Transformer, and underpinned early seq2seq systems like Google Translate's 2016 neural system.

## Your AI and this story

- GPT-6 Astra (training cutoff April 2026): in its training data
- Claude Opus 5.5 (training cutoff June 2026): in its training data
- Gemini 4 Hydrogen (training cutoff March 2026): in its training data
- Grok 4.7 (training cutoff May 2026): in its training data

## Sources

1. [Long Short-Term Memory (Neural Computation, DOI)](https://doi.org/10.1162/neco.1997.9.8.1735) (doi.org, paper)
2. [Wikipedia: Long short-term memory](https://en.wikipedia.org/wiki/Long_short-term_memory) (en.wikipedia.org, discussion)

## Changes

- 2026-09-29 (filed): Created

## Related

- 2017-06-12: ['Attention Is All You Need' introduces the Transformer](https://postcutoff.com/e/2017-06-12-transformer/index.md)
- 2014-09-10: [Sequence-to-sequence learning and neural attention](https://postcutoff.com/e/2014-09-10-seq2seq-attention/index.md)
- People: [Jürgen Schmidhuber](https://postcutoff.com/person/jurgen-schmidhuber/)