17:21
2026-09-06
jdhornsby.com
large-language-models
Please respond in valid JSON
Guided decoding, a technique that constrains large language model token sampling to a formal grammar such as a JSON schema, has moved from hand-built logit manipulation to a near-ubiquitous API featurβ¦