AMD Quark now supports SVDQuant and native Hugging Face Diffusers integration for diffusion models, enabling 4-bit quantization of both weights and activations. On an AMD Instinct MI350 GPU, plain nat…
AMD introduced ROCm AMD Infinity Context (ROCm AIC), a purpose-built KV cache storage tier for distributed inference on AMD Instinct GPUs, starting with MI300X and MI350 Series. ROCm AIC uses low-late…
Researchers present Fleet, a hierarchical task-based abstraction for multi-die GPUs that introduces Chiplet-tasks to exploit chiplet-level locality and synchronization. On AMD Instinct MI350 with Qwen…
AMD Quark, a quantization library optimized for AMD Instinct MI350 GPUs, enables MXFP4 quantization for Diffusers and xDiT FLUX.1-dev image generation, achieving up to 1.92× speedup over BF16 eager an…