Gemini Live’s camera just became much more useful for accessibility
Gemini can now describe your surroundings and guide your camera with spoken cues.
Google has introduced an accessibility-enhancing feature called Guided Vision in its Gemini Live camera app for blind and low-vision users. This new tool allows the AI to describe what the camera sees and provide verbal guidance to help users reposition their shots when necessary. The feature is currently available on Android 9 and newer devices in markets that support Gemini Live.
For individuals with visual impairments, the primary utility of a phone camera is contingent on the device's ability to narrate the scene. Google has been developing towards this goal for over a year, initially introducing visual cues to highlight objects on-screen. However, the company has now transformed this concept into a more accessibility-oriented tool: Guided Vision.
Guided Vision is now being rolled out alongside Gemini Live on compatible Android phones. Once activated through the app, users can share their camera feed and receive real-time verbal descriptions of their surroundings. They can also pose follow-up questions and receive spoken instructions on how to adjust the camera for better results. If Gemini determines that a more optimal view is needed, it will prompt the user to pan right, tilt down, or step back to capture the desired image.
Written by urgent.news from Android Authority's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
