15:12
2026-08-19
leimao.github.io
ai-infrastructure
CUDA Graph In The Context of Multi-Stream Execution
NVIDIA CUDA Graph, a feature designed to reduce CPU overhead and GPU bubbles in single-stream kernel launches, may not improve latency or GPU utilization in multi-stream execution when bubbles stem fr…