{"slug": "show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to", "title": "Show HN: Tracking GenAI cost and endpoint fragility so app teams don't have to", "summary": "LLMIntel, a new tool for tracking generative AI costs and endpoint fragility, launched on Hacker News. The dashboard monitors model pricing, retirement dates, and cost drift across applications, helping engineering teams manage spending and avoid service disruptions. The demo shows a week of realistic traffic from three apps, with features for cost optimization and migration recommendations.", "body_md": "A sample LLMIntel dashboard with a week of realistic traffic across three apps.\n\n**You’re viewing demo data** — this is what LLMIntel looks like with a week of real traffic. Sign up and your own data appears minutes after your first instrumented call.\n\n| Model | State | Retirement |\n|---|---|---|\n|\n\nPricing known for 6 of 6 models you run. Cheapest by input: [gpt-5-nano-2025-08-07](/models/openai/gpt-5-nano-2025-08-07) at $0.05/1M.\n\nWant cheaper/faster on-par alternatives for these models? [See optimization →](#optimization)\n\nTimes in UTC · 13 months of history on your plan · sample data — send telemetry to see your own, range-filtered\n\nCost is frozen at ingest — priced from each model's rates at call time, so past spend never shifts. Window: last 30 days.\n\nTelemetry up to **Jul 7, 16:51 UTC**· 8 min ago· Catalog checked **42 min ago**\n\nThese models are returning more output per input token than their 30-day baseline — the usual cause of silent cost creep. Check prompts, `max_tokens`\n\n, and whether a cheaper or more concise model would do.\n\n| Model | Now | Baseline | Drift | Requests | Spend |\n|---|---|---|---|---|---|\n|\n\nDollars flowing through models that retire within 90 days. Migrate before the provider 4xxs you — see recommended replacements on each model page.\n\n| Model | Retirement | Spend |\n|---|---|---|\n|\n\n| Environment › Application | Requests | Tokens | Blended $/1M | Cost/req | Spend | Share |\n|---|---|---|---|---|---|---|\n| prod | 379,000 | 86M | $13.16 | $0.0030 | $1,131.66 | 88% |\n| Checkout Assistant | 261,000 | 58M | $12.77 | $0.0028 | $742.11 | 58% |\n| Support Copilot | 118,000 | 28M | $13.96 | $0.0033 | $389.55 | 30% |\n| staging | 33,000 | 10M | $14.65 | $0.0046 | $152.40 | 12% |\n| Unassignedno app mapping | 33,000 | 10M | $14.65 | $0.0046 | $152.40 | 12% |\n\n`app`\n\ntag your agent sends or the API key's app mapping; calls with neither show as `app`\n\ntag). | feature | Requests | Tokens | Blended $/1M | Cost/req | Spend | Share |\n|---|---|---|---|---|---|---|\n| checkout | 214,000 | 48M | $12.51 | $0.0028 | $604.32 | 47% |\n| search | 121,000 | 28M | $14.54 | $0.0033 | $401.18 | 31% |\n| summarize | 54,000 | 13M | $14.68 | $0.0035 | $187.96 | 15% |\n| Untaggedno feature tag | 23,000 | 7.7M | $11.77 | $0.0039 | $90.60 | 7% |\n\n| team | Requests | Tokens | Blended $/1M | Cost/req | Spend | Share |\n|---|---|---|---|---|---|---|\n| growth | 268,000 | 61M | $12.75 | $0.0029 | $771.24 | 60% |\n| platform | 144,000 | 33M | $13.70 | $0.0031 | $452.22 | 35% |\n| Untaggedno team tag | 0 | 4.3M | $14.09 | — | $60.60 | 5% |\n\n| Model | Provider | Requests | Input | Output | Blended $/1M | Cost/req | Tokens/req | Out:in | Spend |\n|---|---|---|---|---|---|---|---|---|---|\n|", "url": "https://wpnews.pro/news/show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to", "canonical_source": "https://llmintel.ai/demo", "published_at": "2026-07-07 16:39:58+00:00", "updated_at": "2026-07-07 16:59:59.390451+00:00", "lang": "en", "topics": ["generative-ai", "ai-tools", "ai-infrastructure", "ai-products", "developer-tools"], "entities": ["LLMIntel", "OpenAI", "gpt-5-nano-2025-08-07", "Checkout Assistant", "Support Copilot"], "alternates": {"html": "https://wpnews.pro/news/show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to", "markdown": "https://wpnews.pro/news/show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to.md", "text": "https://wpnews.pro/news/show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to.txt", "jsonld": "https://wpnews.pro/news/show-hn-tracking-genai-cost-and-endpoint-fragility-so-app-teams-don-t-have-to.jsonld"}}