NVIDIA NCCL

NVIDIA reports that two AI computing clusters built from identical H100, GB200 NVL72, or GB300 NVL72 systems can deliver 8% to 12% differences in training throughput due to configuration choices in ke…

AMD has published an analysis of network traffic patterns in AI training clusters, identifying congestion hotspots and harmonic-like oscillations caused by synchronized collective communication operat…