{"slug": "your-llm-cost-estimate-is-wrong-above-200000-tokens", "title": "Your LLM cost estimate is wrong above 200,000 tokens", "summary": "A developer's survey of LLM API pricing found that most comparison tables understate costs for long-context workloads because several providers double their per-token rates above a context threshold. Google's Gemini 3.1 Pro and xAI's Grok 4.6 both double input and output pricing above 200,000 prompt tokens, while OpenAI publishes no rate above 270,000 tokens and Anthropic's Claude 4.6 onward bills a flat per-token rate across its full 1M-token window. The writeup also flags time-of-day pricing for DeepSeek, non-standard cache-read rates, and argues that cost per completed task is a better metric than headline per-token rates.", "body_md": "I went looking for a straight answer to \"what will this cost per month\" and found that almost every comparison table gets it wrong the moment prompts get long. Not slightly wrong. Double.\n\nGemini 3.1 Pro is $2 per million input tokens, $12 per million output. That is the number in every roundup. It holds up to 200,000 prompt tokens, and above that line Google doubles it.\n\nGrok 4.6 does the same thing at the same threshold — $2/$6 becomes $4/$12.\n\nOpenAI's pricing page carries a line that is easy to miss: the published rates cover context lengths under 270,000 tokens. There is no published rate above that.\n\nClaude is the odd one out, and in the useful direction. From Claude 4.6 onward there is no context tier. A 900,000-token prompt bills per token at exactly the rate a 9,000-token prompt does, across the whole 1M window.\n\nTake a coding agent carrying a repository in context, or a RAG pipeline that fills the window because it can. 260,000 input tokens per request is an ordinary day for either.\n\nOn short prompts, Gemini 3.1 Pro's input rate looks 2.5x cheaper than Claude Opus 5's. Cross 200,000 tokens and that gap closes hard, because one of them changed price and the other did not. Every comparison built on headline rates has the ranking wrong for that workload.\n\nNo context tier at all — but since 16 August 2026 it prices by time of day. Peak is 01:00-04:00 and 06:00-10:00 UTC, seven hours out of twenty-four, and rates double inside it. So the honest number for DeepSeek is not a rate, it is a blend that depends on when your traffic actually lands.\n\nThe other quiet assumption is that a cache hit costs 10% of the input rate. Mostly true, not always: Claude Fable 5.1 reads at 0.025x base, not 0.1x. Gemini 3.5 Flash-Lite has no context caching at all, so a comparison that assumes a cache discount is inventing one.\n\nI wrote every current rate up as a reference, including the thresholds, the cache-read rates and the introductory Gemini Flash pricing that expires on 31 December 2026: [LLM API Pricing Reference](https://llmwaves.github.io/llm-api-pricing-reference/)\n\nCost per token decides less than people expect. A model that is half the price and takes three times the tokens to finish the same job is not cheaper. For speed, context window, benchmark scores and cost per task across 323 models, the [LLM Waves leaderboards](https://www.llmwaves.com/leaderboards) track all of it, and the [economics board](https://www.llmwaves.com/leaderboards#economics) ranks by cost per task rather than headline rate.\n\nRates collected from provider documentation on 13 September 2026.", "url": "https://wpnews.pro/news/your-llm-cost-estimate-is-wrong-above-200000-tokens", "canonical_source": "https://dev.to/llmwaves/your-llm-cost-estimate-is-wrong-above-200000-tokens-26ck", "published_at": "2026-09-13 21:12:32+00:00", "updated_at": "2026-09-13 21:21:44.847790+00:00", "lang": "en", "topics": ["large-language-models", "ai-infrastructure", "ai-products", "developer-tools"], "entities": ["Google", "Gemini 3.1 Pro", "xAI", "Grok 4.6", "OpenAI", "Anthropic", "Claude", "DeepSeek"], "alternates": {"html": "https://wpnews.pro/news/your-llm-cost-estimate-is-wrong-above-200000-tokens", "markdown": "https://wpnews.pro/news/your-llm-cost-estimate-is-wrong-above-200000-tokens.md", "text": "https://wpnews.pro/news/your-llm-cost-estimate-is-wrong-above-200000-tokens.txt", "jsonld": "https://wpnews.pro/news/your-llm-cost-estimate-is-wrong-above-200000-tokens.jsonld"}}