{"slug": "google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language", "title": "Google debuts SL2T, an AI model that’s designed to understand sign language", "summary": "Google DeepMind launched SL2T, a multilingual sign-language-to-text AI model that debuts on the Pixel 11 smartphone, powering a new sign-to-text dictation feature in Gboard and Live Transcribe, initially translating American Sign Language to English text. Trained on over 100,000 hours of sign language data spanning more than 50 languages, SL2T is the first such model in a consumer product and achieved a score of 70 BLEURT on the FLEURS-ASL benchmark. The model uses on-device MediaPipe Holistic to track pose coordinates, avoiding video uploads, and supports left-handed and one-handed signing.", "body_md": "### Google debuts SL2T, an AI model that’s designed to understand sign language\n\n[Google DeepMind](https://deepmind.google/) said today it wants to bring the artificial intelligence revolution to the estimated 70 million people across the world who are either deaf or hard of hearing with the launch of sign-language-to-text or SL2T.\n\nIn a blog post, Google’s AI researchers said SL2T is a multilingual translation model that’s making its debut on the Pixel 11 smartphone, where it powers a new “sign-to-text” dictation feature on Gboard and Live Transcribe. The model is initially capable of translating American Sign Language or ASL to English text, and is the first of its kind to be made available within a real-world consumer product, the company said.\n\nAI’s ability to process human speech has progressed enormously in the last few years, to the point where anyone can dictate anything they like in dozens of global languages on a smartphone, tablet or personal computer. But the same isn’t true for those who rely on one of the more than 200 distinct sign languages because of their hearing disabilities. According to Google, it’s an audience that has been completely ignored by the AI industry, until now.\n\nThe SL2T model gives deaf and hard of hearing users the ability to interact with their smartphone using their native language. Just like speech AI makes it possible for users to talk to their device instead of typing, SL2T makes it possible for people to sign directly into their smartphone’s camera rather than tap away entering text.\n\nIt means users can now use sign language to perform dozens of different tasks, including web searches, drafting emails and text messages, editing documents and so on. They can also use SL2T to prompt Gemini to answer queries and perform actions on their behalf. The model is also available in Google’s Live Transcribe app, allowing users to sign their responses directly during face-to-face calls.\n\nGoogle said SL2T was trained on more than 100,000 hours of sign language data spanning over 50 languages, with about a quarter of that dataset made up of ASL communications. While the initial release can only understand ASL, Google said it decided to train the model across multiple sign languages in order to learn the shared structural patterns across them. In this way, it can significantly outperform earlier sign language models.\n\nTo ease users’ privacy concerns, SL2T is powered by an on-device computer vision model called [MediaPipe Holistic](https://research.google/blog/mediapipe-holistic-simultaneous-face-hand-and-pose-prediction-on-device/), which tracks the geometric pose locations across signer’s faces, hands, arms and torso. It then sends the coordinates of these locations to its cloud-based server, avoiding the need to upload any actual video, making it faster and more secure for users.\n\nThe model translates sequences directly into text, bypassing the intermediate text annotations known as “glosses.” By doing this, SL2T is better able to capture the non-manual expressions and spatial grammar structures that are characteristic of ASL, Google said. Other features include optimizations to reduce latency, hallucination prevention mechanisms for non-signing movements and support for both left-handed signers and one-handed signing, so users can interact with it while holding their smartphone in one hand.\n\nGoogle’s performance claims are backed by solid data. SL2T achieved a score of 70 BLEURT on the FLEURS-ASL benchmark.\n\nThe release of SL2T is a key development for deaf communities globally, Google said. The development of AI models that can understand sign languages has been slow due to the unique challenges they present and also some common misconceptions. Unlike spoken languages, which map sequential sounds directly to text, sign languages have their own unique lexicons and grammar that must be translated in an entirely new way.\n\nAnother difficulty is that sign languages convey meaning through simultaneous movements of not just the hands, but also the head, face, arms and torso. But early attempts to develop sign languages focused on hand gestures only, rather than treating them as full-body visual languages.\n\nGoogle signaled to the deaf and hard-of-hearing communities that it’s not going to leave them behind any longer. In addition to releasing SL2T, it has also established the AI Sign Language Advisory Committee in partnership with a number of deaf organizations and sign language experts to help guide the responsible deployment of the technology. The committee will also co-author a report alongside Google that outlines SL2T’s capabilities and its current limitations.\n\nGoing forward, Google plans to expand the model to cover additional sign languages and also develop models for sign language generation.\n\n##### Image: Google DeepMind\n\n# A message from John Furrier, co-founder of SiliconANGLE:\n\nSupport our mission to keep content open and free by engaging with theCUBE community. **Join theCUBE’s Alumni Trust Network**, where technology leaders connect, share intelligence and create opportunities.\n\n**15M+ viewers of theCUBE videos**, powering conversations across AI, cloud, cybersecurity and more** 11.4k+ theCUBE alumni**— Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.\n\n# Are you AWS customer? Support SiliconANGLE Financially by buying your AWS services from our Marketplace portal page and links.\n\n**About SiliconANGLE Media**\n\n[SiliconANGLE](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552),\n\n[theCUBE Network](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da),\n\n[theCUBE Research](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f),\n\n[CUBE365](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6),\n\n[theCUBE AI](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683)and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.\n\nFounded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.", "url": "https://wpnews.pro/news/google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language", "canonical_source": "https://siliconangle.com/2026/08/12/google-debuts-sl2t-ai-model-thats-designed-understand-sign-language/", "published_at": "2026-08-12 14:00:50+00:00", "updated_at": "2026-08-12 14:07:04.044989+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "computer-vision", "natural-language-processing", "ai-products"], "entities": ["Google DeepMind", "Pixel 11", "Gboard", "Live Transcribe", "MediaPipe Holistic", "Gemini", "FLEURS-ASL"], "alternates": {"html": "https://wpnews.pro/news/google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language", "markdown": "https://wpnews.pro/news/google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language.md", "text": "https://wpnews.pro/news/google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language.txt", "jsonld": "https://wpnews.pro/news/google-debuts-sl2t-an-ai-model-thats-designed-to-understand-sign-language.jsonld"}}