NVIDIA's DOCA GPUNetIO has evolved from a standalone GPU-centric packet-processing framework into a unified GDA-KI foundation now integrated across NVSHMEM, NCCL, Aerial 5G SDK, UCX/NIXL, NVQLink with…
A developer's Kubernetes operator, pd-ratio-coordinator, failed to compile on its committed KRAG-1 branch, with two real bugs — a DeepCopy type mismatch in register.go and four unqualified Bottleneck …
AWS EFA's SRD transport moves CUDA buffers roughly 40x faster than tuned TCP, about 13x faster through a shuffle, and roughly 2x faster on the PDS-H Q9 benchmark, according to a blog post recording co…
NVIDIA has released the NVIDIA Inference Xfer Library (NIXL), an open-source library designed to accelerate point-to-point communications in AI inference frameworks such as NVIDIA Dynamo, with support…
Ray Direct Transport (RDT), a feature in Ray Core, enables RDMA-backed weight transfer in reinforcement learning for LLMs, achieving up to 7.5x speedup over naive RDMA implementations on GB200 nodes u…
Google has open-sourced TPU Raiden, an inference optimization library for KV-cache transfer in large language model serving, under the Apache-2.0 license on GitHub, positioning it as a direct counterp…
VLLM's slack-aware preemption policies rescued urgent request attainment at high load in a benchmark on 6× A100 SXM4 80GB GPUs running Llama 70B, where the control policy collapsed to 0% urgent attain…
Nvidia is developing its proprietary CMX platform to improve AI inference economics by offloading KV cache to SSDs via BlueField DPUs, while the open CXL standard offers a vendor-agnostic alternative.…
Scality is enhancing its object storage to support AI workloads by integrating with NVIDIA's NIXL library, enabling S3 over RDMA to bypass CPU bottlenecks and move data directly between flash and GPU …