00:28
2026-07-12
shbhmrzd.github.io
large-language-models
What happens between entering the prompt and seeing the first word appear
The autoregressive generation process of large language models during inference, detailing how a model produces one token at a time by repeatedly running forward passes, sampling from logits, and appe…