Yandex open-sources AliceAI-Foundation-80B-A3B-Base, an 80B/3B-active MoE trained from scratch (Apache 2.0)
Confirmed
The takeaway
On Sept 21, 2026 Yandex released AliceAI-Foundation-80B-A3B-Base on Hugging Face under Apache 2.0: a pretrained (not instruction-tuned) mixture-of-experts model with 80B total and 3B active parameters, 262K context, trained from scratch.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 2 of 5
- Last verified
- 30 September 2026
Your AI and this story
- GPT-6.2 Astra113 days after its cutoff
- Claude Opus 5.583 days after its cutoff
- Gemini 4 Hydrogen174 days after its cutoff
- Grok 4.7113 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 83 days before it.
Key facts
- 80B total / 3B active parameters; 48 layers, hybrid KDA + gated-attention layers; 512 experts (top-10 + 1 shared); 262,144-token context; vocabulary 129,024 (model card)
- License: Apache 2.0; base model only, Russian and English
- Selected model-card scores: MATH-500 91.1%, MMLU-Pro (CoT) 66.8%, EGE CoT 90.5%, FinQA 128k 74.1%, WikiWebFacts 86.5%, HardMultiQA 67.9%
- Yandex claims: outperforms NVIDIA Nemotron-3-Super-120B-Base with about a quarter of its active parameters; matches its previous closed Alice AI LLM with 3x fewer parameters
- Released with two Russian benchmarks, WikiWebFacts and HardMultiQA; training-pipeline notes include a cascade classifier cutting data-prep compute >10x
What happened
Yandex published the base weights of a new from-scratch MoE model, not a fine-tune of Qwen or Llama. It is a small-active-parameter design meant to be cheap to run, and a preview of the architecture of Yandex’s next reasoning model.
Why it matters
It is the most capable open-weights model from a Russian lab so far and adds a strong Russian-language base model under a permissive license. The benchmark claims are Yandex’s own.
Sources
3 sources from 3 sites. Numbers match the chips in the text.
3 sources: 2 primary, 1 reaction
Primary
- Yandex IR: Yandex open-sources new AI model trained from scratch (Sept 21, 2026)ir.yandex, official
- Hugging Face: yandex/AliceAI-Foundation-80B-A3B-Basehuggingface.co, code
Reactions
- DEV Community: Yandex open-sourced an 80B model trained from scratchdev.to, discussion
Changes
- Filed