{"slug": "show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills", "title": "Show HN: NLP capabilities of Opus, Astra, Argon measured by Codenames skills", "summary": "A college student built WordSpies, a Codenames app that fills any seat with an AI teammate or opponent, and benchmarked several LLMs through AWS Bedrock API calls, assigning ELO ratings from win rate and clue/guess accuracy. Gemini 4 Argon topped the ratings at 1775, followed by GPT-6.1 Sol at 1744, GPT-6 Astra at 1723, Claude Fable 5.1 at 1623 and Claude Opus 5.5 at 1592, with the author noting rare exceptions such as Kimi K2.5 slightly edging out Kimi K3. The methodology is published at wordspies.com/hn#method.", "body_md": "Hello Show HN,\n\nI'm a college student, and I enjoy playing word games like Codenames, but it can be hard sometimes to find enough people to play when everyone is available, so I made an app that allows you to fill any seat with an AI teammate and also play against AI. This way it allows for people to get the full strategic experience of codenames just on their own.\n\nThrough this experiment, I was also able to measure and benchmark a few different LLMs through AWS Bedrock API calls and give them ELO ratings based on stuff like win rate and clue/guess accuracy. If anyone is interested, they can see more about my benchmarking methodology here: [https://wordspies.com/hn#method](https://wordspies.com/hn#method). I think it's pretty interesting because it gives you a lot of insight into these various LLMs' NLP capabilities.\n\nA few interesting stats were that I rated Gemini 4 Argon at 1775, GPT-6.1 Sol at 1744, GPT-6 Astra at 1723, Claude Fable 5.1 at 1623, and Claude Opus 5.5 at 1592. You'll find a few interesting things there, like how, although newer, more expensive models tend to perform better, some rare exceptions exist, like Kimi K2.5 slightly edging out Kimi K3.\n\nCheck out the site if you're interested in NLP and data science and want to see what level of frontier LLMs you can beat!\n\nComments URL: [https://news.ycombinator.com/item?id=50420270](https://news.ycombinator.com/item?id=50420270)\n\nPoints: 1\n\n# Comments: 0", "url": "https://wpnews.pro/news/show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills", "canonical_source": "https://wordspies.com/hn", "published_at": "2026-11-09 02:30:51+00:00", "updated_at": "2026-11-09 02:50:33.699862+00:00", "lang": "en", "topics": ["natural-language-processing", "large-language-models", "ai-research", "ai-products"], "entities": ["WordSpies", "AWS Bedrock", "Gemini 4 Argon", "GPT-6.1 Sol", "GPT-6 Astra", "Claude Fable 5.1", "Claude Opus 5.5", "Kimi K2.5"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills", "markdown": "https://wpnews.pro/news/show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills.md", "text": "https://wpnews.pro/news/show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills.txt", "jsonld": "https://wpnews.pro/news/show-hn-nlp-capabilities-of-opus-astra-argon-measured-by-codenames-skills.jsonld"}}