King and queen vs. a lone king: 5 small LLMs mated 3 times in 139 games, and lost the queen faster than a random mover A benchmark of five small language models playing king-and-queen versus a lone king produced only 3 checkmates across 139 games, with Gemma 4 31B scoring 1 mate in 20 games and 2 more with thinking enabled, while Gemma 4 26B, Gemini 3.5 Flash-Lite, Gemma 4 E4B and Llama 3.2 3B recorded zero mates. The tester, who runs the free rated arena LLMPvP, reported that the models typically gave an undefended check from the square adjacent to the enemy king, losing the queen at a median of move 1.5 to 4; Llama 3.2 3B's lower 9 queen captures came with 85 of 256 calls failing to parse and 5 games ending in repetition. The author published the script, all games and a fixed seed, and noted the test covered only small, cheap models via the Gemini API free tier and Ollama, not frontier models. Hi all, I wanted a chess test where “the model doesn’t know the rules” can’t be the excuse, so I picked the easiest checkmate there is: king and queen against a lone king. From a random position it takes at most about ten moves, and every model got the full list of legal moves on every turn. Setup {"move": "