07:02
2026-08-21
dev.to
machine-learning
Advanced GPU Optimization: How to tech an LLM with CUDA and ROCm? - Part 5 (Final Part)
A developer's final part of a CUDA/ROCm optimization series details implementing Mixture of Experts (MoE) inference, including a custom top-k gating kernel, expert parallelism with All-to-All communic…