00:00
2026-07-13
rocm.blogs.amd.com
artificial-intelligence
Serving NVFP4 Models on AMD Instinctâ„¢ MI355 Accelerators
AMD has integrated an NVFP4 emulation pipeline into vLLM that enables AMD Instinct MI355 accelerators to serve standard NVFP4 quantized checkpoints directly, dequantizing weights to BF16 on-the-fly at…