Serving NVFP4 Models on AMD Instinct™ MI355 Accelerators
AMD has integrated an NVFP4 emulation pipeline into vLLM that enables AMD Instinct MI355 accelerators to serve standard NVFP4 quantized checkpoints directly, dequantizing weights to BF16 on-the-fly at GEMM time to keep p…