{"schema":"postcutoff/event@1","as_of":"2026-10-16T12:39:00+02:00","url":"https://postcutoff.com/e/2026-10-15-microsoft-mai-base-2-pretraining/","md":"https://postcutoff.com/e/2026-10-15-microsoft-mai-base-2-pretraining/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-15-microsoft-mai-base-2-pretraining","date":"2026-10-15","date_precision":"day","short_title":"Microsoft AI's MAI-Base-2 base model","deck":null,"takeaway":"On Oct 15, 2026 Microsoft AI described MAI-Base-2, an in-house pre-trained mixture-of-experts base model (2.8T total, 80B active parameters, natively multimodal) trained on 50T tokens on 16k GB200 GPUs in 38 days, with no distillation from other models.","category":"model-release","category_label":"Model releases","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Microsoft AI Lab Notes: Frontier pre-training at Microsoft AI (MAI-Base-2)","url":"https://microsoft.ai/news/frontier-pre-training-at-microsoft-ai/","type":"official","group":"primary","domain":"microsoft.ai"},{"n":2,"title":"Startup Fortune: Microsoft AI chief says his model beat OpenAI's using a quarter the compute","url":"https://startupfortune.com/microsoft-ai-chief-says-his-model-beat-openais-using-a-quarter-the-compute/","type":"press","group":"press","domain":"startupfortune.com"},{"n":3,"title":"Digital Today: Microsoft AI chief says company built model stronger than GPT-5.6 with quarter of computing power","url":"https://www.digitaltoday.co.kr/en/view/115636/microsoft-ai-chief-says-company-built-model-stronger-than-gpt-56-with-quarter-of-computing-power","type":"press","group":"press","domain":"digitaltoday.co.kr"},{"n":4,"title":"Techmeme thread (Oct 15)","url":"https://www.techmeme.com/261015/p59","type":"discussion","group":"reactions","domain":"techmeme.com"}],"official":1,"filed":"2026-10-16","updated":"2026-10-16","orgs":["Microsoft"],"title":"Microsoft AI unveils MAI-Base-2, a 2.8T-parameter base model it says is 4–12x more pre-training-efficient than DeepSeek-V4-Pro-Base","summary":"On Oct 15, 2026 Microsoft AI described MAI-Base-2, an in-house pre-trained mixture-of-experts base model (2.8T total, 80B active parameters, natively multimodal) trained on 50T tokens on 16k GB200 GPUs in 38 days, with no distillation from other models. Microsoft says it beats every open-weight model it tested and is an estimated 4.2–12.3x more FLOPs-efficient than DeepSeek-V4-Pro-Base. Mustafa Suleyman reportedly told staff it is a stronger base model than the one behind OpenAI's GPT-5.6, built with about a quarter of the compute. It is still in post-training and not released.","key_facts":["Architecture: mixture-of-experts, 2.8T total / 80B active parameters; encoder-free vision-language design, pre-trained natively with vision","Data: 50T-token training mixture; vision-language data 18% of the mixture (counting repetition) from 4.5T unique tokens; unique-token corpus ~36% larger than MAI-Base-1; web knowledge cutoff March 2026","'Our pre-training is built on organic data which does not involve distillation from other models'; crawler respects robots.txt; sources on the USTR Notorious Markets list excluded","Compute: 16k GB200 GPUs for 38 days (August–September 2026); average MFU 21%, goodput 89%","Claims (bits-per-byte on held-out text, held-out Microsoft code, vendor-commissioned STEM/maths/Q&A sets): beats every open-weight model tested; 4.2–12.3x more pre-training FLOPs-efficient than DeepSeek-V4-Pro-Base; 6.3–12.7x over MAI-Base-1. Kimi K3, Qwen3.8-2.4T-A95B and MiMo-V2.6-Pro-RL were compared only as post-trained checkpoints","Methods named: scaling ladders with 'source scaling', fitted hyperparameter scaling laws, dropless MoE with fixed-size memory (MoE-layer MFU 24% → 35%), Muon optimizer with resharding, activation gradient clipping","Availability: none yet; post-training under way, weights to be licensed to 'trusted partners' through Foundry; MAI-Base-3 in preparation","Suleyman to employees (reported Oct 15–16, Business Insider via secondary coverage): stronger than the OpenAI base model behind GPT-5.6, using about a quarter of its training compute; based on Microsoft's own information about OpenAI's models; OpenAI did not comment"],"key_numbers":[],"tags":["microsoft","mai","pretraining","moe","base-model","scaling","compute-efficiency","gb200","muon"],"science":null,"body_md":"## What happened\n\nIn a Lab Notes post on Oct 15, 2026, Microsoft AI described **MAI-Base-2**, the base (pre-trained, not yet post-trained) model\nbehind its next generation of in-house models. It is a sparse mixture-of-experts with 2.8 trillion total and 80 billion active\nparameters. It was trained on a 50-trillion-token mixture that includes images from the start, on 16,000 Nvidia GB200 GPUs over\n38 days in August and September. Microsoft stresses that its data is \"organic\" and not distilled from other models.\n\nMicrosoft measures quality as bits-per-byte on held-out text, its own unpublished code and commissioned STEM and Q&A sets.\nOn that basis it says MAI-Base-2 beats every open-weight model it tested. It puts the model at 4.2–12.3 times more\nFLOPs-efficient in pre-training than DeepSeek-V4-Pro-Base, the strongest open base model it could test, and 6.3–12.7 times more\nthan its own MAI-Base-1. The post does not list per-benchmark scores in text; they are in figures.\n\nBusiness Insider then reported that Mustafa Suleyman told employees MAI-Base-2 is a stronger base model than the OpenAI model\nbehind GPT-5.6, trained with about a quarter of the compute. This entry relies on secondary coverage of that report, since the\nBusiness Insider article was not read directly. The comparison rests on Microsoft's own information about OpenAI's models, and\nOpenAI did not comment.\n\n## Why it matters\n\nUnder the restructured Microsoft–OpenAI deal, Microsoft can build frontier models of its own. This is the first time it has given\ndetailed pre-training numbers at frontier scale (2.8T parameters, ~16k GB200s) and said publicly that its base model beats\nits partner's. All efficiency figures are Microsoft's own, measured on evaluation sets it chose and has not published, so they\nare unverified. The model is not available yet. Microsoft says it plans to license weights to trusted partners rather than\nrelease them openly.","disputed":[],"related":[{"id":"2026-06-02-microsoft-mai-models-build-2026","url":"https://postcutoff.com/e/2026-06-02-microsoft-mai-models-build-2026/","date":"2026-06-02","date_precision":"day","short_title":"Microsoft launches seven in-house MAI models at Build 2026, led by MAI-Thinking-1","deck":null,"takeaway":"Coming weeks after the renegotiated OpenAI deal, the launch shows Microsoft hedging its OpenAI dependence with a first-party model family deployed across its biggest products.","category":"model-release","category_label":"Model releases","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":4,"official":2,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Microsoft"]},{"id":"2026-04-27-microsoft-openai-deal-restructured","url":"https://postcutoff.com/e/2026-04-27-microsoft-openai-deal-restructured/","date":"2026-04-27","date_precision":"day","short_title":"Microsoft and OpenAI restructure partnership, drop the AGI clause and exclusivity","deck":null,"takeaway":"The change freed Microsoft to push its own first-party MAI models.","category":"business","category_label":"Business","importance":4,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":3,"official":0,"filed":"2026-09-29","updated":"2026-09-29","orgs":["Microsoft","OpenAI"]}],"people":[{"id":"mustafa-suleyman","name":"Mustafa Suleyman","url":"https://postcutoff.com/person/mustafa-suleyman/"}],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-16","type":"filed","text":"Created (Microsoft AI post read directly; Suleyman remarks from secondary coverage of Business Insider)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-16","run":null,"sources_read":"Microsoft AI post read directly; Suleyman remarks from secondary coverage of Business Insider","updated":"2026-10-16","human_review":null,"version":{"date":"2026-10-16"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":168,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":107,"in_training_data":false},{"model_id":"gemini-4-argon","name":"Gemini 4 Argon","cutoff":"2026-03","days_after":198,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":137,"in_training_data":false}],"short_url":"https://postcutoff.com/s/microsoft-ai-mai-base-2-base"}