Microsoft want to record your face and feed it to a generative AI, telling it to go off and design a game from your frown

Microsoft has filed a patent for technology that would record players' facial expressions, vocalizations and in-game actions, feed that data to a generative AI, and use it to generate new game content such as objectives, sidequests, NPCs, dialogue and items. The patent describes a two-stage process in which designers first prompt an AI to build narrative elements, then the system continues analyzing player reactions during play to generate further content. The filing signals Microsoft's interest in adaptive, AI-driven game design tied to real-time player biometric and behavioral signals.

A new patent from Microsoft shows how they want to record your facial expressions, show them to an AI, and have it redesign the game you're playing. It's not only your face they want, but also any words you might be muttering, growls you might be making, or, dare I say, even purrs. The broader technology described in the patent is a process for game designers to prompt an AI to build out the narrative elements of a game, including objectives, sidequests, NPCs, dialogue, and items. Rather than stop at that first pass, the process would continue when players are in the game, analysing how they're playing to then generate new content based on their actions and reactions. A quick peek behind the curtain: I, too, am using this technology and the rest of this article has been rewritten to match exactly the facial expression you are making right… now.