{"slug": "show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes", "title": "Show HN: NerfWatch() – Track AI degradation with daily tests and community votes", "summary": "A new Show HN project called NerfWatch launched to track AI model degradation by running the same daily test on each model and comparing results only against that model's own first week, with community voting to corroborate the numbers. The site's first results, dated September 25 with the next test set for September 26, show GPT-6 Astra at 93%, Grok 4.7 at 91%, Muse Spark 1.3 at 89%, and Claude Opus 5.5 at 85%, each flagged \"Too soon\" with only one run and too few community votes to reach a verdict. NerfWatch also offers a single email alert when a model's verdict changes.", "body_md": "Last test Sep 25 · next test Sep 26\n\n# Did they nerf it? We test. You vote.\n\nEvery model takes the same test every day and is only ever compared with its own first week. Then it's your turn: say how it feels, and see if the numbers back you up.\n\n## Get an alert when a model gets nerfed\n\nOne email when a verdict changes. Nothing else.\n\n[GPT-6 Astra](models/openrouter-openai-gpt-6-astra-openai.html)gpt-6-astra · low\n\nBenchmark\n\n93%\nToo soon\n1 run so far\nCommunity\n\n–\nToo few votes\nNot enough data on either side yet.\n\nWhat do you think?\n\n[Grok 4.7](models/openrouter-x-ai-grok-4.7-xai.html)grok-4.7 · low\n\nBenchmark\n\n91%\nToo soon\n1 run so far\nCommunity\n\n–\nToo few votes\nNot enough data on either side yet.\n\nWhat do you think?\n\n[Muse Spark 1.3](models/openrouter-meta-muse-spark-1.3-meta.html)muse-spark-1.3 · low\n\nBenchmark\n\n89%\nToo soon\n1 run so far\nCommunity\n\n–\nToo few votes\nNot enough data on either side yet.\n\nWhat do you think?\n\n[Claude Opus 5.5](models/openrouter-anthropic-claude-opus-5.5-anthropic.html)claude-opus-5.5 · low\n\nBenchmark\n\n85%\nToo soon\n1 run so far\nCommunity\n\n–\nToo few votes\nNot enough data on either side yet.\n\nWhat do you think?", "url": "https://wpnews.pro/news/show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes", "canonical_source": "https://nerfwatch.lol", "published_at": "2026-09-25 21:21:12+00:00", "updated_at": "2026-09-25 21:31:26.615368+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-products", "ai-tools"], "entities": ["NerfWatch", "GPT-6 Astra", "Grok 4.7", "Muse Spark 1.3", "Claude Opus 5.5", "OpenAI", "xAI", "Anthropic"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes", "markdown": "https://wpnews.pro/news/show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes.md", "text": "https://wpnews.pro/news/show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes.txt", "jsonld": "https://wpnews.pro/news/show-hn-nerfwatch-track-ai-degradation-with-daily-tests-and-community-votes.jsonld"}}