Google brings sign language AI translation to smartphones

Google DeepMind has introduced SL2T, a sign-language-to-text AI model that powers sign-to-text dictation in Gboard and Live Transcribe on Pixel 11, initially supporting American Sign Language (ASL) to English, marking the first time sign language AI is available in consumer products. Trained on over 100,000 hours of data covering more than 50 sign languages, SL2T processes on-device body tracking and sends only geometric coordinates for translation, ensuring privacy. The model is available at no additional cost on Pixel 11, with plans to expand to more sign languages and devices.

Google brings sign language AI translation to smartphones Google https://qazinform.com/tag/google DeepMind has introduced https://deepmind.google/blog/putting-sign-language-ai-into-users-hands/ a new sign-language-to-text model designed to help Deaf and hard of hearing users communicate through their phones, bringing sign language AI https://qazinform.com/tag/ai to consumer products for the first time, Qazinform https://qazinform.com/ News Agency correspondent reports. The model, called SL2T, powers sign-to-text dictation in Gboard and Live Transcribe on Pixel 11, initially supporting American Sign Language ASL to English. Google said more devices and sign languages will follow. The technology allows users to sign anywhere they would normally type. They can use it to search the web, draft messages and documents, or ask Gemini to complete tasks. In Live Transcribe, users can sign responses during conversations instead of typing them. Unlike spoken language transcription, sign language translation requires AI to understand independent languages with their own grammars and vocabularies, as well as complex movements involving the hands, arms, torso, head and face. SL2T was trained on more than 100,000 hours of data covering over 50 sign languages, with about a quarter of the data in ASL. Google said training across different languages, dialects and proficiency levels helps the model learn shared structures. For privacy, the system does not send raw camera footage to the server. An on-device model tracks points on the signer’s body, and only the resulting geometric coordinates are sent for translation. The original video can then be discarded immediately. The company developed the system with members and organizations from the Deaf community, including through user studies and the AI Sign Language Advisory Committee. SL2T is currently available in Gboard and Live Transcribe on Pixel 11 at no additional cost. Google said it plans to expand the technology to additional sign languages and develop sign language generation capabilities. Earlier, Qazinform https://qazinform.com/ News Agency reported that Google launched https://qazinform.com/news/google-launches-video-selfie-verification-for-account-sign-ins-433930 video selfie verification for account sign-ins.