{"slug": "microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters", "title": "Microsoft reveals cutting-edge MAI-Base-2 model with 2T parameters", "summary": "Microsoft Corp.'s AI research group detailed MAI-Base-2, a 2-trillion-parameter base model with a mixture-of-experts architecture that activates 80 billion parameters per prompt and, Microsoft says, outperforms DeepSeek-V4-Pro-Base on internal science, programming and math benchmarks while being up to 12 times more hardware-efficient by certain measures. Microsoft trained MAI-Base-2 for 38 days on 16,000 Nvidia GB200 chips using a 50-trillion-token dataset, about a fifth of which trained an integrated computer vision module, and used gradient clipping plus the open-source Muon tool to stabilize and speed training. Microsoft will license the model's weights to \"trusted partners\" through Azure and use it to power a new series of LLMs it plans to detail soon.", "body_md": "### Microsoft reveals cutting-edge MAI-Base-2 model with 2T parameters\n\nMicrosoft Corp. has developed a new large language model that it says is significantly more efficient than leading open-source alternatives.\n\nThe company’s artificial intelligence research group [detailed](https://microsoft.ai/news/frontier-pre-training-at-microsoft-ai/) the algorithm on Thursday.\n\nMAI-Base-2 is not a full-fledged LLM but rather a base model, a kind of no-frills prototype. Developers turn base models into LLMs by putting them through several additional rounds of training. That extra training usually focuses on adding reasoning features and safety guardrails.\n\nThe most capable open-source base model on the market today is DeepSeek-V4-Pro-Base. Microsoft says that MAI-Base-2 outperformed it on a series of internal benchmarks that contained science, programming and math questions. Furthermore, MAI-Base-2 is up to 12 times more hardware-efficient by certain measures.\n\nMAI-Base-2 features a mixture of experts, or MoE, architecture, which means that it only uses a subset of its artificial neurons to process prompts. That’s more efficient than activating the entire neural network. MAI-Base-2 has 2 trillion parameters and activates 80 billion of them when it receives a prompt.\n\nA language model’s artificial neurons are organized into clusters called layers. Microsoft’s previous-generation base model mixed MoE layers with modules based on a less efficient design called FFN. MAI-Base-2 is made up entirely of MoE layers, which is one of the contributors to its performance.\n\nMicrosoft trained the model for 38 days using 16,000 of Nvidia Corp.’s GB200 chips. The training dataset used in the project comprised 50 trillion tokens. About a fifth of the tokens were used to train a computer vision module integrated into MAI-Base-2. The module makes the model better than its predecessor at tasks such as understanding scientific charts.\n\nDevelopers train LLMs by observing the manner in which they complete tasks and providing feedback on how they can improve. That feedback, which is generated algorithmically, takes the form of a mathematical object called a gradient. The gradient travels through the layers of the model being trained and re-calibrates each one to boost its output quality.\n\nGradients change every time they pass through an LLM layer. Under certain circumstances, those changes cause bugs that can disrupt the training workflow. Microsoft employed a method called gradient clipping to prevent that issue from affecting MAI-Base-2. It also used Muon, a popular open-source AI tool, to speed up the training workflow.\n\nMicrosoft will license MAI-Base-2’s weights to “trusted partners” through its Azure cloud platform. Additionally, it will use the model to power a new series of LLMs. The company plans to share more information about those models in the near future.\n\n##### Photo: Microsoft\n\n# A message from John Furrier, co-founder of SiliconANGLE:\n\nSupport our mission to keep content open and free by engaging with theCUBE community. **Join theCUBE’s Alumni Trust Network**, where technology leaders connect, share intelligence and create opportunities.\n\n- **15M+ viewers of theCUBE videos** , powering conversations across AI, cloud, cybersecurity and more\n- **11.4k+ theCUBE alumni** — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network\n\n### Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: [https://siliconangle.com/aws-marketplace/](https://siliconangle.com/aws-marketplace/)\n\n##### **About SiliconANGLE Media**\n\n[SiliconANGLE](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552),\n\n[theCUBE Network](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da),\n\n[theCUBE Research](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f),\n\n[CUBE365](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6),\n\n[theCUBE AI](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683)and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.\n\nFounded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.", "url": "https://wpnews.pro/news/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters", "canonical_source": "https://siliconangle.com/2026/10/16/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters/", "published_at": "2026-10-17 00:39:50+00:00", "updated_at": "2026-10-17 00:58:25.783131+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-infrastructure", "ai-chips"], "entities": ["Microsoft Corp.", "MAI-Base-2", "DeepSeek-V4-Pro-Base", "Nvidia Corp.", "GB200", "Azure", "Muon"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters", "markdown": "https://wpnews.pro/news/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters.md", "text": "https://wpnews.pro/news/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters.txt", "jsonld": "https://wpnews.pro/news/microsoft-reveals-cutting-edge-mai-base-2-model-with-2t-parameters.jsonld"}}