09:33
2026-06-20
dev.to
large-language-models
Tracking token usage across OpenAI, Anthropic, and Gemini: every streaming gotcha I hit
A developer building Spanlens, an open-source LLM observability tool, found that OpenAI, Anthropic, and Gemini report token usage differently during streaming, requiring distinct parsing logic for eac…