{"slug": "show-hn-trackllm-are-the-llm-apis-you-rely-on-stable", "title": "Show HN: TrackLLM: Are the LLM APIs you rely on stable?", "summary": "TrackLLM, a monitoring project posted to Hacker News, reports that 839 of 1,743 cataloged LLM API endpoints are being tracked and that 191 changes occurred across 150 endpoints, with probe-prompt outputs shifting as recently as 11 Sep at total variation values of 0.20 and 0.23. The dashboard lists changed endpoints including Tencent's hy3 on atlas-cloud/fp8 (3 changes, last change 28 Aug), Anthropic's claude-sonnet-4.5 on claude-on-aws (2 changes, 9 Sep), DeepSeek's deepseek-v4-flash-0731 on streamlake/fp8 (2 changes, 1 Sep), and Z.ai's glm-5.2 across cloudflare, gmicloud/fp8, together, and z-ai/fp8 (2 changes each). The tracking data matters because it gives developers a public record of how much hosted model behavior drifts from baseline over time.", "body_md": "11 Sep\n\nProbe-prompt outputs shifted (total variation 0.20)\n\nB3IT\n\n11 Sep\n\nProbe-prompt outputs shifted (total variation 0.23)\n\nB3IT\n\n10 Sep\n\nProbe-prompt outputs shifted (total variation 0.38)\n\nB3IT\n\n9 Sep\n\nProbe-prompt outputs shifted (total variation 0.21)\n\nB3IT\n\n7 Sep\n\nProbe-prompt outputs shifted (total variation 0.36)\n\nB3IT\n\n5 Sep\n\nProbe-prompt outputs shifted (total variation 0.28)\n\nB3IT\n\n4 Sep\n\nProbe-prompt outputs shifted (total variation 0.34)\n\nB3IT\n\n3 Sep\n\nProbe-prompt outputs shifted (total variation 0.55)\n\nB3IT\n\n2 Sep\n\nProbe-prompt outputs shifted (total variation 0.34)\n\nB3IT\n\n[More…](changes.html)\n\n[More…](providers.html)\n\n## [Endpoints](endpoints.html)\n\n839 endpoints monitored, of 1,743 in the catalog · **191 changes** across 150 endpoints\n\n[All endpoints →](endpoints.html)\n\n| Endpoint | Status | Changes | Methods | Last change | Drift from baseline | \n|---|---|---|---|---|---|\n| [hy3](endpoints/tencent2fhy323atlas-cloud2ffp8.html)[atlas-cloud/fp8](providers/atlas-cloud.html) | changed | 3 | B3IT | 28 Aug |  | \n| [claude-sonnet-4.5](endpoints/anthropic2fclaude-sonnet-4.523claude-on-aws.html)[claude-on-aws](providers/claude-on-aws.html) | changed | 2 | B3IT | 9 Sep |  | \n| [deepseek-v4-flash-0731](endpoints/deepseek2fdeepseek-v4-flash-073123streamlake2ffp8.html)[streamlake/fp8](providers/streamlake.html) | changed | 2 | LTB3IT | 1 Sep |  | \n| [glm-5.2](endpoints/z-ai2fglm-5.223cloudflare.html)[cloudflare](providers/cloudflare.html) | changed | 2 | B3IT | 14 Aug |  | \n| [glm-5.2](endpoints/z-ai2fglm-5.223gmicloud2ffp8.html)[gmicloud/fp8](providers/gmicloud.html) | changed | 2 | LTB3IT | 29 Aug |  | \n| [glm-5.2](endpoints/z-ai2fglm-5.223together.html)[together](providers/together.html) | changed | 2 | B3IT | 24 Aug |  | \n| [glm-5.2](endpoints/z-ai2fglm-5.223z-ai2ffp8.html)[z-ai/fp8](providers/z-ai.html) | changed | 2 | B3IT | 19 Aug |  | \n| [gpt-4o-2024-05-13](endpoints/openai2fgpt-4o-2024-05-1323azure.html)[azure](providers/azure.html) | changed | 2 | LT | 21 May |  | \n| [gpt-4o-mini](endpoints/openai2fgpt-4o-mini23azure.html)[azure](providers/azure.html) | changed | 2 | LTB3IT | 23 May |  | \n| [hy3](endpoints/tencent2fhy323deepinfra2ffp8.html)[deepinfra/fp8](providers/deepinfra.html) | changed | 2 | B3IT | 20 Aug |  | \n\n[More…](endpoints.html)", "url": "https://wpnews.pro/news/show-hn-trackllm-are-the-llm-apis-you-rely-on-stable", "canonical_source": "https://www.trackllm.net/", "published_at": "2026-09-14 06:38:39+00:00", "updated_at": "2026-09-14 07:02:35.431099+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools", "large-language-models", "ai-products", "mlops"], "entities": ["TrackLLM", "Hacker News", "Tencent", "hy3", "Anthropic", "claude-sonnet-4.5", "DeepSeek", "Z.ai"], "alternates": {"html": "https://wpnews.pro/news/show-hn-trackllm-are-the-llm-apis-you-rely-on-stable", "markdown": "https://wpnews.pro/news/show-hn-trackllm-are-the-llm-apis-you-rely-on-stable.md", "text": "https://wpnews.pro/news/show-hn-trackllm-are-the-llm-apis-you-rely-on-stable.txt", "jsonld": "https://wpnews.pro/news/show-hn-trackllm-are-the-llm-apis-you-rely-on-stable.jsonld"}}