Changes that cut our LLM pipeline costs more than model-switching did
A developer reports that switching from JSON to TOON for structured output, using condensed markdown, and replacing long instruction lists with multi-shot examples reduced their LLM pipeline costs by …