03:00
2026-07-15
pub.towardsai.net
large-language-models
I Watched XGrammar Forbid a Token: What Grammar-Constrained Decoding Actually Does to Your Logits
XGrammar, a library used by inference engines such as vLLM and SGLang, performs grammar-constrained decoding by masking invalid tokens from the sampling distribution at each generation step, guarantee…