Meta Patents Technology to Detect Your Mood by Constantly Analyzing Your Tone of Voice

Meta has patented an AI system that constantly analyzes a user's voice and surroundings to detect their emotional state, combining audio with contextual factors like time and location. The technology aims to improve fitness guidance by tailoring workouts to mood, but raises significant privacy concerns as it involves continuous audio monitoring. Amazon previously attempted a similar feature with its Halo Band but discontinued it after backlash.

Meta patented AI tech that constantly analyzes your voice and surroundings in order to detect your emotional state. Finally, exactly what we were all asking for: Meta being granted constant access to our offline lives. As first caught by Patentlyze https://patentlyze.com/patent/meta-ai-tracks-your-emotions-time/ , a patent published on July 2 describes a system that records all the user’s “audible communications” and combines it with “contextual factors” like “time of day, location, user activity, or digital interaction.” Audio may be “transcribed, and an emotional-state machine learning model may interpret verbal and nonverbal cues to determine emotional indicators.” In other words, the system listens to you and everything you do, combines it with other data, and feeds it all to a mood-predicting AI. “The system increases the precision and reliability of emotional inference by aligning multimodal sensor inputs on synchronized timelines, which creates a novel data structure that supports richer emotional analysis,” reads the patent. “These combined features deliver a technical improvement in automated audio interpretation, enabling continuous emotional monitoring on everyday devices.” According to the patent, the goal of this extraordinarily intrusive system would be to better tailor users’ workouts to their emotional state, as “personal trainers cannot provide the level of precision in guidance, such as correcting a pose and/or body movement,” as well as Meta’s imagined device could. It’s not surprising to see Meta pitch this kind of surveillance technology as a fitness device. Health-tracking wearables have become wildly popular, despite the extraordinary amount of physical data about individual consumers they collect and store. The key difference in Meta’s case, is that rather than crunch biological metrics, it’s an AI-powered fly-on-the-wall attempting to measure a person’s emotional state by listening in on the world around them, and possibly then connecting that information to all other available data. “The AI assistant may listen to a user s at predefined times to hear various types of communication, such as sighs, laughter, and/or the tone s of a voice s ,” reads the patent. “The AI assistant may use these inputs to quantify the user’s emotional state or generate other insights about the user.” The patent also discusses connecting audio inputs to information like when a user takes their medicine, proposing that “the AI assistant may take multiple inputs in addition to audio inputs e.g., of a user’s voice to provide a summary of emotional trends based on various inputs e.g., a happier emotional state associated with a particular time of day or at a time when medication is taken, etc. ” It’s worth noting that fellow tech giant Amazon tried and failed to market a similar system. In 2020, the company launched the Halo Band, a fitness band with a built-in microphone that was designed to listen in on users and conduct what Amazon described https://www.aboutamazon.com/news/devices/a-new-tool-to-help-you-understand-and-improve-your-social-wellbeing as a “tone of voice analysis.” Following public backlash in 2021, Amazon nuked https://www.androidcentral.com/halo-view-amazon-privacy-tone the microphones when it launched a next-generation version of the band. It discontinued https://www.aboutamazon.com/news/company-news/amazon-halo-discontinued the product line altogether in 2023. Whether we’ll ever see Meta attempt to launch a similar mood-tracking device is unclear. In a statement to 404 Media https://www.404media.co/meta-patents-ai-device-that-tracks-your-emotions-watches-you-take-your-meds/ , a Meta spokesperson said that “like other companies, patents at Meta are often filed to disclose concepts that may or may not be implemented, and a granted patent does not guarantee that Meta has pursued or will pursue the technology described.” The existence of the patent, though, shows that such a device is certainly on Meta’s mind — and is yet another Meta-made product https://futurism.com/future-society/backlash-meta-pervert-glasses-afraid that stands to strengthen the bridge between our online and offline https://futurism.com/artificial-intelligence/meta-lied-smart-glasses-privacy-class-action-lawsuit worlds. More on Meta products: The Backlash Is So Strong That People With “Pervert Glasses” Are Afraid to Use Them in Public https://futurism.com/future-society/backlash-meta-pervert-glasses-afraid