Show HN: Redactle LLM Leaderboard

A developer who was 'nerd sniped' into evaluating language models on the puzzle game Redactle found that Google's Gemini Flash outperforms all other models in both performance and cost, one-shotting every evaluation in just a few seconds. The findings are presented in a new Redactle LLM Leaderboard shared on Hacker News.

I got nerd sniped and ran a bunch of evaluations to see how well models could play Redactle. It turns out Gemini flash is in a league of it's own in both performance and cost. It's able to one-shot every eval in a just a few seconds. Comments URL: https://news.ycombinator.com/item?id=49544338 https://news.ycombinator.com/item?id=49544338 Points: 1 Comments: 0