DCGM

Databricks AI engineers detailed how they maintain GPU reliability at scale, describing failure modes including crashed jobs, silent slowdowns, and numerical corruption, and outlining a multi-stage he…

A developer has built an open-source agent that correlates NCCL AllReduce stalls with TCP retransmits on the same host, revealing network bottlenecks that GPU dashboards miss. The tool attaches uprobe…

Running large language model inference servers like vLLM and TGI in production requires specialized observability because they behave differently from standard web services, with key metrics like late…