21:42
2026-08-22
mapathak-commits.github.io
large-language-models
How LLM Serves a Request
Manas Pathak's primer explains that an LLM server processes a request in two phases—prefill, which reads the entire prompt in one forward pass, and decode, which generates each output token in a separ…