04:56
2026-07-16
thegustafson.com
large-language-models
Unicode, Bytes, and What Text Actually Is
A language model does not see letters or pixels; it sees a sequence of integers from a vocabulary table, and the raw input is just bytes. Unicode assigns every character a unique integer code point, b…