Mistral AI releases Mixtral 8x7B, an open mixture-of-experts model
Confirmed
The takeaway
Paris-based Mistral AI released Mixtral 8x7B under Apache 2.0, a sparse mixture-of-experts model that matched or beat Llama 2 70B and GPT-3.5 on many benchmarks while using ~13B active parameters per token.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- Announced 11 December 2023 (weights shared via torrent days earlier)
- 46.7B total parameters, ~12.9B active per token
- Apache 2.0 license
- Paper: arXiv 2401.04088
What happened
Mistral published a high-quality open-weights sparse MoE model with a fully permissive license.
Why it matters
Popularized mixture-of-experts in open models (later used by DeepSeek-V3, Llama 4, Qwen) and established Europe’s leading AI startup.
Sources
2 sources from 2 sites. Numbers match the chips in the text.
2 sources: 2 primary
Primary
- Mixtral of experts (Mistral AI)mistral.ai, official
- Mixtral of Experts (arXiv)arxiv.org, paper
Changes
- Filed