# The Ultimate MoE Training Handbook: training Mixture-of-Experts models with Megatron-LM, setting by setting [P] > Source: > Published: 2026-11-05 21:01:07+00:00 Handbook: https://huggingface.co/spaces/huggingface/moe-blogpost Hello, I'm Nouamane, one of the authors. I'm at Hugging Face and also worked on the Ultra-Scale and Smol Training Playbooks, if you've read those. This handbook is for people who have trained a dense model and want to train an MoE next