Genshin Impact developer miHoYo has created an AI that can play games, with researchers teaching it to fight, solve puzzles, and tackle quests in Honkai: Star Rail.
In research published on November 13, miHoYo introduced a new AI called Gamer that is capable of playing through Honkai: Star Rail using mouse and keyboard commands.
During video demonstrations, Gamer battled enemies, freely explored environmental sections to complete quests, and even defeated a boss.
miHoYo’s researchers say the technology could help developers test whether quests and other features work as intended and even cut down development costs.
Genshin Impact developer teaches AI to play Honkai: Star Rail #
Gamer uses screenshots to understand what’s happening before sending keyboard and mouse commands to control the game.
Researchers also paired recorded gameplay with instructions, explanations of key decisions, and memory summaries to help give the AI the tools it needs to understand its objectives and retain information.
All the above essentially allows it to freely move characters, adjust the camera, navigate menus, and interact with its surroundings as if it were a real player.
Once the groundwork had been laid, researchers then put Gamer’s skill to the test by having it run through two Honkai: Star Rail side quests: Opportunity Makes the Thief (Part I) and Bestial Ferocity. For those who don’t know, these quests require players to travel between locations, speak to characters, fight enemies, and solve a simple puzzle.
While it’s still early days, Gamer achieved scores of 80% and 83.6% against the two quests’ objectives. However, results were more mixed when it came to puzzles, where Gamer achieved an average success rate of 49.7% across 40 tasks spanning seven Star Rail minigame types. It did score 95.8% on Navigation Compass puzzles, but its score dropped to 22.2% on Abacus Circuitry. As for why this new AI technology is being tested, miHoYo believes Gamer could help devs check whether quests and interactions work correctly. Meanwhile, having it explore areas and attempt objectives could support testing new content, allowing problems to be reproduced and fixed before they’re rolled out to live servers.