How a GPT-2 Decoder Actually Predicts the Next Word
A technical walkthrough explains how GPT-2's decoder processes a 768-wide vector through 12 layers to predict the next word, detailing every matrix multiplication and parameter count without hand-waving. The article demo…