how LLMs remember, schedule, and stream tokens
A developer built a small CPU-based inference runtime called kutty-vllm in Python and NumPy to understand how large language models remember, schedule, and stream tokens, implementing a KV cache with block-based allocati…