NVML

A developer on Hacker News is asking how GPU power draw is measured at scale in self-hosted setups, sharing per-GPU data from NVML polling and questioning whether per-request attribution survives at r…

NVIDIA's ASUS Ascent GX10 edge AI system, powered by the GB10 SoC, lacks any supported software interface for CPU energy measurement, making process-level energy attribution impossible on the platform…

A developer has built an open-source agent that correlates NCCL AllReduce stalls with TCP retransmits on the same host, revealing network bottlenecks that GPU dashboards miss. The tool attaches uprobe…