Rebellions, a Korean neural processing unit (NPU) designer, will supply its ATOM-Max Servers to public surveillance control centers operated by the South Gyeongsang Provincial Government and Ulsan Met…
AMD shows how to serve the pre-quantized amd/Kimi-K2.5-MXFP4 checkpoint on AMD Instinct MI355X GPUs using ATOM, a lightweight vLLM-like framework that integrates AITER kernels and exposes an OpenAI-co…
AMD has optimized MiniMax-M3 inference on Instinct MI355X GPUs using ATOM, AITER, and ATOMesh, achieving improvements in serving throughput, token latency, and accuracy through online quantization, sp…
AMD Instinct MI355X GPUs with ATOM and ATOMesh achieve competitive inference performance for MiniMax-M3, a 428-billion-parameter multimodal MoE model, outperforming NVIDIA B200 and B300 in per-GPU thr…
AMD introduced ROCm Infera, an open-source distributed inference reference solution for large-scale deployments, claiming it can improve goodput per GPU for agentic AI workloads by up to 2.6× in inter…
AMD introduced SGLang-ATOM, a bridge connecting the SGLang serving framework with ATOM's ROCm-native execution path to accelerate large language model inference on AMD Instinct GPUs. The integration u…
AMD introduces DP Attention and Two-Batch Overlap (TBO) optimizations for DeepSeek-V4 inference on MI355X GPUs, using a coordinated prefill scheduler called PrefillDelayer to reduce padding waste and …
AMD released ATOM and ATOMesh, a ROCm-native LLM serving stack for Instinct GPUs on June 16, 2026, that disaggregates prefill and decode phases to eliminate head-of-line blocking. The open-source stac…
AMD shipped ATOM + ATOMesh, a ROCm-native LLM serving stack for Instinct GPUs that implements prefill/decode disaggregation, splitting the two inference phases onto separate GPU pools to optimize for …