Pixel 11 introduces a new way for deaf users to communicate with people who don’t know sign language

Google’s Pixel 11 series introduces a groundbreaking feature to facilitate communication between deaf and hard-of-hearing users and those unfamiliar with sign language. This innovative accessibility feature utilizes the device’s camera to recognize sign language and translates it into text in real-time. This enables a more natural, two-way conversation during face-to-face interactions without the need for typing responses.

The new AI model, called sign-language-to-text (SL2T), developed by Google DeepMind, marks a significant breakthrough in translating sign language at scale. Once the Pixel Camera captures a user signing, the model quickly translates it and Gboard automatically converts it into text, allowing users to communicate seamlessly across various platforms such as web searches, messages, documents, and Gemini queries.

Currently, the feature supports American Sign Language to English translations on the Pixel 11 series, with plans to expand to more languages and additional devices in the future. To ensure user privacy, the system analyzes the signer’s body location points on-device, rather than processing raw video, and only sends the necessary coordinates to Google’s servers for translation before deleting the original camera feed.

The model has been trained on over 100,000 hours of data encompassing more than 50 sign languages, including specific testing for left-handed and one-handed signers. While the model outperforms previous sign language translation systems on benchmark tests, its performance in real-world conditions, such as poor lighting or casual conversations, remains to be seen.

With an estimated 70 million deaf and hard-of-hearing individuals worldwide relying on sign language, Google DeepMind emphasizes this is the first time sign language AI has reached such a scale in a consumer product. The success of SL2T in everyday signing scenarios will determine whether it becomes a genuine communication tool or another AI feature that fails to live up to its potential.

Meanwhile, Samsung is reportedly testing a 3x telephoto system across its Galaxy S27 series, including the regular, plus, and ultra models, while addressing battery capacity concerns by experimenting with batteries ranging from 5,700mAh to 6,000mAh.