AMD Quark

AMD Quark now supports SVDQuant and native Hugging Face Diffusers integration for diffusion models, enabling 4-bit quantization of both weights and activations. On an AMD Instinct MI350 GPU, plain nat…

AMD Quark, a quantization library optimized for AMD Instinct MI350 GPUs, enables MXFP4 quantization for Diffusers and xDiT FLUX.1-dev image generation, achieving up to 1.92× speedup over BF16 eager an…

AMD announced the acceleration of large-scale LLM inference on its Instinct MI350X/MI355X GPUs using Eagle3 speculative decoding and AMD Quark quantization. The work enables lossless inference speedup…