Meta patented an AI system that listens to your voice all day and tracks your mood

Meta has been granted a patent for an AI system that continuously records a user's voice to detect their emotional state, combining audio with location, activity, and medication data. The patent, published on July 2, describes a device that listens for audible communications and builds a persistent mood log, raising privacy concerns similar to those that led Amazon to abandon its Halo Band in 2023.

TL;DR Meta patented an AI system that continuously records voice to detect emotional state. It combines audio with location and activity data. Amazon tried and abandoned a similar product. The patent describes recording "audible communications" and combining them with location, time, and medication data. Amazon killed a similar product in 2023. Meta patented an AI system that continuously records voice to detect emotional state. It combines audio with location and activity data. Amazon tried and abandoned a similar product. Meta has been granted a patent for an AI system that continuously records a user’s voice, https://futurism.com/artificial-intelligence/meta-patent-detects-mood-constantly-analyzing-voice transcribes it, and feeds the audio through a machine learning model to detect their emotional state. The patent, published on July 2, describes a device that listens for “ audible communications ” including sighs, laughter, and vocal tone, and combines them with “ contextual factors ” like time of day, location, activity, and medication timing. The system builds a persistent mood log from all of this. The patent, first spotted by Patentlyze, frames the technology as a fitness tool. Meta argues that AI-powered emotional coaching could correct workout posture and adjust guidance in ways a human personal trainer cannot. But the architecture described goes well beyond a gym session. The system is designed for “ continuous emotional monitoring on everyday devices, ” using what the patent calls “ multimodal sensor inputs on synchronized timelines. ” It listens at “ predefined times ” for tone, pace, pauses, and breathing, then quantifies the user’s emotional state. It can correlate mood with medication schedules, producing summaries like “ a happier emotional state associated with a particular time of day or at a time when medication is taken. ” Amazon tried something similar. In 2020, it launched the Halo Band, a fitness wearable with a built-in microphone that performed “ tone of voice analysis. ” After public backlash, Amazon removed the microphones from the next-generation model in 2021 and discontinued the product line entirely in 2023. Meta’s smart glasses are already the subject of a privacy crisis https://thenextweb.com/news/meta-smart-glasses-privacy-crisis-apple-google-snap over covert recording, with seven million pairs sold and two US lawsuits alleging the company misled consumers about how footage was handled. Adding persistent ambient voice recording to the product line would extend the surveillance from what users see to how they feel. A Meta spokesperson told 404 Media https://www.404media.co/meta-patents-ai-device-that-tracks-your-emotions-watches-you-take-your-meds/ that “ patents at Meta are often filed to disclose concepts that may or may not be implemented. ” That is standard corporate hedging. But the patent’s specificity, down to medication tracking and emotion-time correlations, suggests more than speculative filing. Kenyan data workers already lost their jobs after revealing they reviewed intimate footage captured by Meta’s glasses https://thenextweb.com/news/meta-smart-glasses-sama-kenya-workers . If this patent becomes a product, someone will need to train the emotional model too, which means someone will be listening to recordings of strangers sighing, laughing, and talking to themselves at home, labelling each one with a mood score so the algorithm can learn what sadness sounds like. Get the most important tech news in your inbox each week.