{"slug": "ask-hn-what-are-other-uncrackable-benchmarks", "title": "Ask HN: What are other \"uncrackable benchmarks\"?", "summary": "A Hacker News user asked the community for examples of private or 'hidden' AI benchmarks, citing their own unpublished benchmark based on a doctoral thesis and questioning whether discussing such benchmarks devalues them and whether a leak-proof test set can be created. The post received 3 points and 1 comment as of the time of writing.", "body_md": "I have my own benchmark for AI just based off my Doctoral Thesis, which isn't public(university constraints). I am wondering if other people have other \"hidden\" benchmarks? I have a few I have made, and one wonder if talking about them devalues them, and two can a good test set be made that can't be leaked?\n\nComments URL: [https://news.ycombinator.com/item?id=49593357](https://news.ycombinator.com/item?id=49593357)\n\nPoints: 3\n\n# Comments: 1", "url": "https://wpnews.pro/news/ask-hn-what-are-other-uncrackable-benchmarks", "canonical_source": "https://news.ycombinator.com/item?id=49593357", "published_at": "2026-09-07 02:57:41+00:00", "updated_at": "2026-09-07 03:27:07.839590+00:00", "lang": "en", "topics": ["ai-research", "ai-safety"], "entities": ["Hacker News"], "alternates": {"html": "https://wpnews.pro/news/ask-hn-what-are-other-uncrackable-benchmarks", "markdown": "https://wpnews.pro/news/ask-hn-what-are-other-uncrackable-benchmarks.md", "text": "https://wpnews.pro/news/ask-hn-what-are-other-uncrackable-benchmarks.txt", "jsonld": "https://wpnews.pro/news/ask-hn-what-are-other-uncrackable-benchmarks.jsonld"}}