FlashInfer on ROCm 10.1: The FlashInfer API with Automatic Kernel Routing FlashInfer on ROCm 10.1 brings the FlashInfer attention and LLM serving kernel API to AMD Instinct GPUs with automatic kernel routing, adding FP8 prefill, POD-Attention (prefill and decode overlapped in one kernel), fused mixture-of-experts (MoE), and AITER decode under CUDA graph capture. The release also lands cascade attention, multi-head latent attention (MLA), and standalone rotary position embedding (RoPE) ops that were in progress in the earlier prefill-attention release. It runs on CDNA3 (gfx942: MI300X and MI325X) and CDNA4 (gfx950: MI350X and MI355X) GPUs. FlashInfer