A Scheduler as a Lens into LLM Inference
A developer built a small scheduler in Go to understand vLLM's scheduler for LLM inference, tracing each design decision back to its vLLM equivalent. The scheduler operates in a tick loop with three phases—drain, reclaim…