MXFP8

The Allen Institute for AI (Ai2) released Olmo-core 3, an open-source training framework that scales mixture-of-experts large language models to over one trillion parameters while growing the expert p…

NVIDIA published a tutorial showing how its Transformer Engine (TE) and BioNeMo MoE recipe cut the overhead of training mixture-of-experts biological foundation models, using GroupedLinear to submit e…

Vulkan 1.4.356 introduces the VK_EXT_shader_ocp_microscaling_types extension, adding support for Open Compute Project Microscaling MX data types (MXFP4, MXFP6, MXFP8, MXINT8) to improve machine learni…