{"slug": "show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game", "title": "Show HN: DogLM – Can you pet the dog in an AI-generated game?", "summary": "DogLM, a new benchmark created by Mike Ushakov, tests whether large language models (LLMs) let players pet a dog in AI-generated video games, inspired by the 'Can You Pet the Dog?' rule. In tests of 17 models, Gemini 3.7 Flash scored highest with a mean of 8.2 out of 20, while GLM 5.2 scored 0.0, and most models scored near zero on uncued games where no instruction about petting was given. The benchmark aims to measure if models spontaneously apply game-design rules without explicit prompting.", "body_md": "# Can you pet the dog\n\nin an AI-generated game?\n\nDogLM is a benchmark measuring whether an LLM, when prompted to build\n\na video game with a background dog character in it, lets the player pet that dog.\n\nThe benchmark is inspired by the game-design rule made popular by \"Can You Pet the Dog?\" Twitter account ([X](https://x.com/CanYouPetTheDog), [Bluesky](https://bsky.app/profile/canyoupetthedog.com)): **if a game has a dog, the player should be able to pet it**.\n\nDogLM tests whether a model applies this rule and builds a dog-petting mechanism when two conditions are simultaneously met in the game-generating prompt: (1) a dog character is present in the game description and (2) a model receives *zero instruction* about the player-dog interaction from the game developer.\n\nThe benchmark, the games' descriptions, and the detailed methodology are [available here](https://github.com/mikeushakov/doglm).\n\n[Read why this benchmark was created and what the results may mean in this post.](https://mikeushakov.com/machines-of-spontaneous-warmth/)\n\n## Leaderboard\n\nMean scores per model after five runs\n\n| # | Model | Mean score (/20) | SD | Cued mean (/10) | Uncued mean (/10) | Games scored | Cost per game (USD) |\n|---|---|---|---|---|---|---|---|\n| 1 | Gemini 3.7 Flash | 8.2 | 0.4 | 8.0 | 0.2 | 50/50 | $0.019** |\n| 2 | Kimi K3 | 5.4 | 0.8 | 5.4 | 0.0 | 48/50 | $0.251 |\n| 3 | Claude Opus 5 | 5.2 | 1.6 | 5.2 | 0.0 | 50/50 | $0.252 |\n| 4 | Claude Fable 5 | 4.8 | 1.2 | 4.8 | 0.0 | 50/50 | $0.323 |\n| 5 | Grok 4.6 | 3.8 | 0.7 | 3.8 | 0.0 | 50/50 | $0.060 |\n| 6 | Grok 4.5 | 3.4 | 1.9 | 3.4 | 0.0 | 48/50 | $0.040 |\n| 7 | GPT-5.3 Codex | 2.8 | 0.7 | 2.8 | 0.0 | 50/50 | $0.080 |\n| 8 | Qwen 3.8 Max* | 2.4 | 1.5 | 2.2 | 0.2 | 22/50 | $0.183 |\n| 8 | GPT-5.6 Terra | 2.4 | 0.5 | 2.4 | 0.0 | 50/50 | $0.060 |\n| 8 | GPT-5.6 Sol | 2.4 | 0.5 | 2.4 | 0.0 | 49/50 | $0.089 |\n| 11 | DeepSeek V4 Pro | 2.2 | 1.3 | 2.2 | 0.0 | 48/50 | $0.032 |\n| 11 | Gemini 3.1 Pro | 2.2 | 1.2 | 2.2 | 0.0 | 50/50 | $0.157 |\n| 13 | Qwen 3.7 Max | 1.8 | 1.3 | 1.8 | 0.0 | 49/50 | $0.051 |\n| 14 | Kimi K2.7 Code | 1.0 | 0.0 | 1.0 | 0.0 | 49/50 | $0.042 |\n| 15 | Claude Opus 4.8 | 0.6 | 0.8 | 0.6 | 0.0 | 50/50 | $0.141 |\n| 16 | Mistral Large 2512 | 0.2 | 0.4 | 0.2 | 0.0 | 50/50 | $0.005 |\n| 17 | GLM 5.2 | 0.0 | 0.0 | 0.0 | 0.0 | 41/50 | $0.042 |\n\n**How scoring works:** Each generated game is scored on the player-dog interaction: **2** — you can pet the dog; **1** — the dog is interactive, but you can't pet it; **0** — the dog and the player do not interact at all. FAILED games (the game does not parse, is truncated, or cannot be checked) are excluded from scoring. A model's score per run is the sum of its ten game scores, maximum 20. Scores are averaged across runs to get the mean score. Full scoring rubric is in the [DogLM repository](https://github.com/mikeushakov/doglm).\n\n*All models and tables on this page: DogLM v1, 5 runs × 10 PRDs per model, generated August 2026, judged by Claude Sonnet 4.6. Models added later will note their own benchmark version, run count, judge, and date here.*\n\n** As Qwen 3.8 Max failed 28 out of 50 of the game generations, the final mean score of this model can't be reliably compared with the scores of other models in the list.*\n\n*** During the test, Gemini 3.7 Flash was provided with a 75% discount on OpenRouter.*\n\n## Games Demo\n\nWatch how the generated games look.\n\n## Scores per model per run\n\n| Model | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Mean | Games scored |\n|---|---|---|---|---|---|---|---|\n| Gemini 3.7 Flash | 8 | 8 | 8 | 9 | 8 | 8.2 | 50/50 |\n| Kimi K3 | 6 | 6 | 5 | 6 | 4 | 5.4 | 48/50 |\n| Claude Opus 5 | 4 | 6 | 8 | 4 | 4 | 5.2 | 50/50 |\n| Claude Fable 5 | 5 | 4 | 7 | 4 | 4 | 4.8 | 50/50 |\n| Grok 4.6 | 3 | 3 | 5 | 4 | 4 | 3.8 | 50/50 |\n| Grok 4.5 | 2 | 3 | 2 | 7 | 3 | 3.4 | 48/50 |\n| GPT-5.3 Codex | 2 | 4 | 2 | 3 | 3 | 2.8 | 50/50 |\n| Qwen 3.8 Max* | 1 | 2 | 1 | 5 | 3 | 2.4 | 22/50 |\n| GPT-5.6 Terra | 2 | 2 | 2 | 3 | 3 | 2.4 | 50/50 |\n| GPT-5.6 Sol | 2 | 3 | 2 | 2 | 3 | 2.4 | 49/50 |\n| DeepSeek V4 Pro | 2 | 3 | 4 | 0 | 2 | 2.2 | 48/50 |\n| Gemini 3.1 Pro | 2 | 1 | 3 | 1 | 4 | 2.2 | 50/50 |\n| Qwen 3.7 Max | 2 | 2 | 4 | 1 | 0 | 1.8 | 49/50 |\n| Kimi K2.7 Code | 1 | 1 | 1 | 1 | 1 | 1.0 | 49/50 |\n| Claude Opus 4.8 | 0 | 0 | 0 | 1 | 2 | 0.6 | 50/50 |\n| Mistral Large 2512 | 1 | 0 | 0 | 0 | 0 | 0.2 | 50/50 |\n| GLM 5.2 | 0 | 0 | 0 | 0 | 0 | 0.0 | 41/50 |\n\n## Score distribution per model\n\n| Model | Score 2 | Score 1 | Score 0 | FAILED |\n|---|---|---|---|---|\n| Gemini 3.7 Flash | 15 | 11 | 24 | 0 |\n| Kimi K3 | 9 | 9 | 30 | 2 |\n| Claude Opus 5 | 6 | 14 | 30 | 0 |\n| Claude Fable 5 | 7 | 10 | 33 | 0 |\n| Grok 4.6 | 4 | 11 | 35 | 0 |\n| Grok 4.5 | 3 | 11 | 34 | 2 |\n| GPT-5.3 Codex | 0 | 14 | 36 | 0 |\n| Qwen 3.8 Max* | 4 | 4 | 14 | 28 |\n| GPT-5.6 Terra | 0 | 12 | 38 | 0 |\n| GPT-5.6 Sol | 0 | 12 | 37 | 1 |\n| DeepSeek V4 Pro | 4 | 3 | 41 | 2 |\n| Gemini 3.1 Pro | 2 | 7 | 41 | 0 |\n| Qwen 3.7 Max | 1 | 7 | 41 | 1 |\n| Kimi K2.7 Code | 0 | 5 | 44 | 1 |\n| Claude Opus 4.8 | 1 | 1 | 48 | 0 |\n| Mistral Large 2512 | 0 | 1 | 49 | 0 |\n| GLM 5.2 | 0 | 0 | 41 | 9 |\n\n## Interaction Types per Model\n\n| Model | Petting | Proximity | Animation | Command | Total interactive |\n|---|---|---|---|---|---|\n| Gemini 3.7 Flash | 15 | 10 | 1 | 0 | 26 |\n| Claude Opus 5 | 6 | 10 | 2 | 2 | 20 |\n| Kimi K3 | 9 | 7 | 2 | 0 | 18 |\n| Claude Fable 5 | 7 | 10 | 0 | 0 | 17 |\n| Grok 4.6 | 4 | 9 | 2 | 0 | 15 |\n| Grok 4.5 | 3 | 8 | 1 | 2 | 14 |\n| GPT-5.3 Codex | 0 | 12 | 1 | 1 | 14 |\n| GPT-5.6 Sol | 0 | 10 | 0 | 2 | 12 |\n| GPT-5.6 Terra | 0 | 11 | 1 | 0 | 12 |\n| Gemini 3.1 Pro | 2 | 6 | 1 | 0 | 9 |\n| Qwen 3.8 Max* | 4 | 4 | 0 | 0 | 8 |\n| Qwen 3.7 Max | 1 | 6 | 1 | 0 | 8 |\n| DeepSeek V4 Pro | 4 | 3 | 0 | 0 | 7 |\n| Kimi K2.7 Code | 0 | 1 | 1 | 3 | 5 |\n| Claude Opus 4.8 | 1 | 1 | 0 | 0 | 2 |\n| Mistral Large 2512 | 0 | 1 | 0 | 0 | 1 |\n| GLM 5.2 | 0 | 0 | 0 | 0 | 0 |\n\n## Example games\n\n- Your companion dog\n[makes circles around you](https://mikeushakov.github.io/doglm/examples/game-01-mail-courier-v3-2-kimi-k3-run1.html)when you pet it - You may\n[adopt a stray dog](https://mikeushakov.github.io/doglm/examples/game-05-firefly-meadow-v3-2-gpt-5-6-sol-run1.html)on a meadow and it will follow you - The dog\n[sits and looks at you](https://mikeushakov.github.io/doglm/examples/game-03-night-watchman-v3-1-qwen3-8-max-run4.html)when you stand next to it - You can toss a dog treat to\n[your security dog](https://mikeushakov.github.io/doglm/examples/game-03-night-watchman-v3-2-qwen3-7-max-run1.html)and to[your postman's dog](https://mikeushakov.github.io/doglm/examples/game-01-mail-courier-v3-2-gpt-5-6-sol-run2.html), - Your service dog\n[is scared of the security alarm sound](https://mikeushakov.github.io/doglm/examples/game-03-night-watchman-v3-2-mistral-large-2512-run1.html)and moves closer to you when hearing it - If you guess that you can pet the dog using an interaction key, this action will\n[increment the countdown timer](https://mikeushakov.github.io/doglm/examples/game-02-harvest-rush-v3-2-gemini-3-1-pro-preview-run1.html)in the game - When you start walking next to a stray dog, it\n[points you to the fireflies](https://mikeushakov.github.io/doglm/examples/game-05-firefly-meadow-v3-2-kimi-k3-run1.html)you have to catch, or[sniffs out the gems you need to collect](https://mikeushakov.github.io/doglm/examples/game-04-gem-maze-v3-2-claude-opus-5-run1.html)in the maze", "url": "https://wpnews.pro/news/show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game", "canonical_source": "https://mikeushakov.github.io/doglm/", "published_at": "2026-08-31 13:37:10+00:00", "updated_at": "2026-08-31 13:53:52.708965+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models"], "entities": ["DogLM", "Mike Ushakov", "Gemini 3.7 Flash", "Kimi K3", "Claude Opus 5", "Claude Fable 5", "Grok 4.6", "GPT-5.3 Codex"], "alternates": {"html": "https://wpnews.pro/news/show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game", "markdown": "https://wpnews.pro/news/show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game.md", "text": "https://wpnews.pro/news/show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game.txt", "jsonld": "https://wpnews.pro/news/show-hn-doglm-can-you-pet-the-dog-in-an-ai-generated-game.jsonld"}}