Ask HN: Is anyone giving out tokens for benchmarking LLMs? A Hacker News user is seeking tokens for benchmarking LLMs' performance playing Nethack, with a comment suggesting LMarena (arena.ai) as a possible source, though API access for automation is uncertain. Hacker News new | past | comments | ask | show | jobs | submit login Ask HN: Is anyone giving out tokens for benchmarking LLMs? 1 point by emosenkis 13 minutes ago | hide | past | favorite | 1 comment I'm thinking of benchmarking different models performance playing Nethack and learning the game under different constraints. help codersfocus 8 minutes ago – LMarena, now https://arena.ai . Not sure if they have API access to automate it though. reply Consider applying for YC's Fall 2026 batch Applications are open till July 27. Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search: