00:00
2026-07-22
rocm.blogs.amd.com
artificial-intelligence
Introducing ROCm™ AMD Infinity Context: A Purpose-Built KV Cache Tier for Distributed Inference
AMD introduced ROCm AMD Infinity Context (ROCm AIC), a purpose-built KV cache storage tier for distributed inference on AMD Instinct GPUs, starting with MI300X and MI350 Series. ROCm AIC uses low-late…