23:11
2026-08-14
github.com
developer-tools
Show HN: Kvcachescope – Why Nvidia-smi is blind to vLLM KV cache leaks
Kvcachescope, a logical memory profiler and state inspector for PagedAttention inference engines such as vLLM and SGLang, exposes KV cache leaks that standard GPU profilers like nvidia-smi miss by hoo…