Microsoft AI’s MAI-Base-2 base model
Confirmed
Importance: major (4 of 5)The takeaway
On Oct 15, 2026 Microsoft AI described MAI-Base-2, an in-house pre-trained mixture-of-experts base model (2.8T total, 80B active parameters, natively multimodal) trained on 50T tokens on 16k GB200 GPUs in 38 days, with no distillation from other models.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- Major (4 of 5)
- Last verified
- 16 October 2026
Your AI and this story
- GPT-6 Astra168 days after its cutoff
- Claude Opus 5.5107 days after its cutoff
- Gemini 4 Argon198 days after its cutoff
- Grok 4.7137 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 107 days before it.
Key facts
- Architecture: mixture-of-experts, 2.8T total / 80B active parameters; encoder-free vision-language design, pre-trained natively with vision
- Data: 50T-token training mixture; vision-language data 18% of the mixture (counting repetition) from 4.5T unique tokens; unique-token corpus ~36% larger than MAI-Base-1; web knowledge cutoff March 2026
- ‘Our pre-training is built on organic data which does not involve distillation from other models’; crawler respects robots.txt; sources on the USTR Notorious Markets list excluded
- Compute: 16k GB200 GPUs for 38 days (August–September 2026); average MFU 21%, goodput 89%
- Claims (bits-per-byte on held-out text, held-out Microsoft code, vendor-commissioned STEM/maths/Q&A sets): beats every open-weight model tested; 4.2–12.3x more pre-training FLOPs-efficient than DeepSeek-V4-Pro-Base; 6.3–12.7x over MAI-Base-1. Kimi K3, Qwen3.8-2.4T-A95B and MiMo-V2.6-Pro-RL were compared only as post-trained checkpoints
- Methods named: scaling ladders with ‘source scaling’, fitted hyperparameter scaling laws, dropless MoE with fixed-size memory (MoE-layer MFU 24% → 35%), Muon optimizer with resharding, activation gradient clipping
- Availability: none yet; post-training under way, weights to be licensed to ‘trusted partners’ through Foundry; MAI-Base-3 in preparation
- Suleyman to employees (reported Oct 15–16, Business Insider via secondary coverage): stronger than the OpenAI base model behind GPT-5.6, using about a quarter of its training compute; based on Microsoft’s own information about OpenAI’s models; OpenAI did not comment
What happened
In a Lab Notes post on Oct 15, 2026, Microsoft AI described MAI-Base-2, the base (pre-trained, not yet post-trained) model behind its next generation of in-house models. It is a sparse mixture-of-experts with 2.8 trillion total and 80 billion active parameters. It was trained on a 50-trillion-token mixture that includes images from the start, on 16,000 Nvidia GB200 GPUs over 38 days in August and September. Microsoft stresses that its data is “organic” and not distilled from other models.
Microsoft measures quality as bits-per-byte on held-out text, its own unpublished code and commissioned STEM and Q&A sets. On that basis it says MAI-Base-2 beats every open-weight model it tested. It puts the model at 4.2–12.3 times more FLOPs-efficient in pre-training than DeepSeek-V4-Pro-Base, the strongest open base model it could test, and 6.3–12.7 times more than its own MAI-Base-1. The post does not list per-benchmark scores in text; they are in figures.
Business Insider then reported that Mustafa Suleyman told employees MAI-Base-2 is a stronger base model than the OpenAI model behind GPT-5.6, trained with about a quarter of the compute. This entry relies on secondary coverage of that report, since the Business Insider article was not read directly. The comparison rests on Microsoft’s own information about OpenAI’s models, and OpenAI did not comment.
Why it matters
Under the restructured Microsoft–OpenAI deal, Microsoft can build frontier models of its own. This is the first time it has given detailed pre-training numbers at frontier scale (2.8T parameters, ~16k GB200s) and said publicly that its base model beats its partner’s. All efficiency figures are Microsoft’s own, measured on evaluation sets it chose and has not published, so they are unverified. The model is not available yet. Microsoft says it plans to license weights to trusted partners rather than release them openly.
Sources
4 sources from 4 sites. Numbers match the chips in the text.
4 sources: 1 primary, 2 press, 1 reaction
Primary
- Microsoft AI Lab Notes: Frontier pre-training at Microsoft AI (MAI-Base-2)microsoft.ai, official
Press
- Startup Fortune: Microsoft AI chief says his model beat OpenAI’s using a quarter the computestartupfortune.com, press
- Digital Today: Microsoft AI chief says company built model stronger than GPT-5.6 with quarter of computing powerdigitaltoday.co.kr, press
Reactions
- Techmeme thread (Oct 15)techmeme.com, discussion
Changes
- Filed (Microsoft AI post read directly; Suleyman remarks from secondary coverage of Business Insider)