{"slug": "ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses", "title": "Ask HN: How do you find out if the LLM API is giving degraded responses", "summary": "A developer on Hacker News asks how others detect degraded responses from LLM APIs like OpenAI, Claude, and Gemini, including slow time-to-first-token, elevated error rates, and model drift. The user seeks to understand if this is a widespread issue and whether an independent alert service for LLM behavior drift would be valuable.", "body_md": "If you are building on top of multiple LLM APIs or even a single one amongst OpenAI, Claude, Gemini, etc. what do you do when the API starts degrading (slow TTFT, elevated error rates, timeouts). Or even worse, when there are responses but the model is drifting. How do you find this out? I'm trying to understand if this is a widespread pain or just something I've been unlucky with.\n\nFour specific questions:\n\n1. When an LLM API starts silently degrading, how do you currently find out? (Your own monitoring? User complaints? Checking the status page? Reddit?)\n\n2. How long does it typically take you to confirm \"this is the provider, not my code\"?\n\n3. If something told you before you noticed, that Claude API was showing elevated TTFT on Sonnet right now, would that change anything about how you operate? Or would you just retry and move on regardless?\n\n4. Would you pay for an independent alert service that tells you when an LLM's behaviour has drifted, before your users notice?\n\nIf this isn't actually a problem for you, I think that also would be the most useful answer I can get.\n\nComments URL: [https://news.ycombinator.com/item?id=48582429](https://news.ycombinator.com/item?id=48582429)\n\nPoints: 1\n\n# Comments: 0", "url": "https://wpnews.pro/news/ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses", "canonical_source": "https://news.ycombinator.com/item?id=48582429", "published_at": "2026-06-18 08:24:21+00:00", "updated_at": "2026-06-18 08:53:52.242968+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "developer-tools"], "entities": ["OpenAI", "Claude", "Gemini", "Hacker News"], "alternates": {"html": "https://wpnews.pro/news/ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses", "markdown": "https://wpnews.pro/news/ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses.md", "text": "https://wpnews.pro/news/ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses.txt", "jsonld": "https://wpnews.pro/news/ask-hn-how-do-you-find-out-if-the-llm-api-is-giving-degraded-responses.jsonld"}}