Cutting AI Context Costs at Scale: Tool Overhead, Caching, Compaction
Reused input dominates token bills because every API call resends the full conversation history, with one Codex user recording 3.59 billion reused tokens out of 3.77 billion total in a single day. Ant…