10:42
2026-07-18
github.com
developer-tools
The Htop for LLM Inference
LLM Inspector, a new open-source CLI tool from developer Helal Saoudi, analyzes live LLM inference processes to show exactly how GPU memory is used by weights, KV cache, and workspace, then projects o…