MXFP4

A team has run the full Kimi K3 model, a 2.8-trillion-parameter mixture-of-experts (MoE) model, on 80 RTX 5090 GPUs achieving 20 tokens per second single-stream inference on day one without tuning, ma…

Researchers propose MXAttention, a data-free post-training quantization framework for MXFP4 attention that introduces Universal Optimal Scaling (UOS) with a distribution-independent optimal scaling bo…

Vulkan 1.4.356 introduces the VK_EXT_shader_ocp_microscaling_types extension, adding support for Open Compute Project Microscaling MX data types (MXFP4, MXFP6, MXFP8, MXINT8) to improve machine learni…