word2vec: efficient word embeddings from Google
Confirmed
Importance: major (4 of 5)The takeaway
Tomas Mikolov and colleagues at Google introduced word2vec (CBOW and skip-gram), which learned dense word vectors capturing semantic relationships like king − man + woman ≈ queen.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- Major (4 of 5)
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- arXiv 1301.3781 ‘Efficient Estimation of Word Representations in Vector Space’ (January 2013)
- Follow-up NeurIPS 2013 paper added negative sampling
- Open-source C implementation released by Google
- Won the NeurIPS 2023 Test of Time award
What happened
Simple shallow networks trained on billions of words produced embeddings where vector arithmetic reflected meaning.
Why it matters
Popularized learned embeddings, a core building block of all subsequent NLP including Transformers and LLMs.
Sources
3 sources from 2 sites. Numbers match the chips in the text.
3 sources: 2 primary, 1 reaction
Primary
- Efficient Estimation of Word Representations in Vector Space (arXiv)arxiv.org, paper
- Distributed Representations of Words and Phrases (arXiv)arxiv.org, paper
Reactions
- Wikipedia: Word2vecen.wikipedia.org, discussion
Changes
- Filed