Become a member of GB MAX to gain exclusive access to the industry and to the most influential global B2B leadership community in the business of gaming, entertainment, and tech.
Join nowand also get a VIP ticket to GamesBeat Next (Nov 2-3, SF).Skillprint today launched the beta for Skillprint Signal Benchmark, the first public benchmark that scores how effectively AI models can enhance real human performance.
Existing benchmarks measure what a model knows, how accurately it answers questions or how well it performs a fixed task. Signal measures something no one else does: how well a model adapts a live game, in real time, to move a real person toward a target mental state, such as greater focus, relaxation or improvement in a cognitive skill, the company said.
Signal places AI models inside live gameplay experiences with real participants. As someone plays, the model can adjust parameters of the game in real time toward a defined human outcome, such as greater focus or relaxation. Signal then measures the resulting change in the player’s state and ranks models based on how effectively they achieve that outcome.
Signal is built on six years of Skillprint research spanning more than 500,000 players and a library of more than 1,000 games, quizzes and simulations designed to understand relationships between gameplay, cognition, mood and player state.
The launch marks a new phase for Skillprint, which has spent six years building a gameplay-powered intelligence platform around a central belief: AI should augment human capability, not replace it.
“Most AI benchmarks tell you how smart a model is on its own. Based on our years of decoding human cognition at scale, we’ve built the one that tells you whether it can actually help a human being, and enhance their performance and intelligence. As AI becomes part of everyday life, we think that is one of the measures that will matter most,” said Chethan Ramachandran, CEO of Skillprint, in a statement.