04:00
2026-10-12
machinebrief.com
ai-infrastructure
Deploying RDMA for Large-Scale Inference and Training Workloads
ByteDance deployed ByteExpress, a software communication layer over hardware RDMA, in its parameter-server-based inference and training systems, cutting mean and P99 model parameter fetch latency by 3…