Meta releases Llama 3 (8B, 70B)
Confirmed
The takeaway
Meta released Llama 3 8B and 70B, trained on over 15 trillion tokens, which set a new bar for open-weight models and powered the Meta AI assistant across Meta’s apps.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- Released 18 April 2024
- Trained on over 15T tokens (about 7x Llama 2)
- New tokenizer with a 128K vocabulary
- Followed by Llama 3.1 405B in July 2024
What happened
Meta openly released strong mid-sized models with a heavily scaled training corpus.
Why it matters
Showed the benefit of training small models far past Chinchilla-optimal, and narrowed the open/closed gap.
Sources
2 sources from 2 sites. Numbers match the chips in the text.
2 sources: 2 primary
Primary
- Introducing Meta Llama 3 (Meta AI)ai.meta.com, official
- meta-llama/llama3 (code)github.com, code
Changes
- Filed