nvidia-smi Reports 97% Utilization While the GPU Sits Idle
A developer found that `nvidia-smi` reported 97% GPU utilization on an H100 cluster while actual training throughput was less than half of expected benchmarks. Tracing via eBPF revealed the GPU was idle 51.7% of the time…