Prime Intellect Releases Prime Mega MoE: Trainable Fused MoE Kernel, 3.11x Faster Forward Pass

Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek's fused Mega MoE kernel that makes the kernel trainable and delivers a 3.11x faster forward pass. The release speeds Qwen3 MoE training steps by up to 34% in Prime Intellect's prime-rl reinforcement learning framework.

Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek’s fused Mega MoE kernel. It makes the kernel trainable and speeds Qwen3 MoE training steps by up to 34% in prime-rl. The post Prime Intellect Releases Prime Mega MoE: Trainable Fused MoE Kernel, 3.11x Faster Forward Pass https://www.marktechpost.com/2026/10/29/prime-intellect-prime-mega-moe-fused-moe-kernel-training/ appeared first on MarkTechPost https://www.marktechpost.com .