AMD Quark

AMD Quark, a quantization library optimized for AMD Instinct MI350 GPUs, enables MXFP4 quantization for Diffusers and xDiT FLUX.1-dev image generation, achieving up to 1.92× speedup over BF16 eager an…

AMD announced the acceleration of large-scale LLM inference on its Instinct MI350X/MI355X GPUs using Eagle3 speculative decoding and AMD Quark quantization. The work enables lossless inference speedup…