MI355

AMD's GEAK agent-driven framework automated the optimization of the DeepSeekV4 MLA kernel, achieving a 2.10x improvement in end-to-end throughput and a 3.71x reduction in time-to-first-token on MI355 …

AMD researchers implemented INT3 quantization in QuickReduce, a high-performance all-reduce library for ROCm, achieving a 22% reduction in on-wire data volume compared to INT4 on MI355 GPUs. The INT3 …