Guided Vision in Gemini Live: built for accessibility

Guided Vision in Gemini Live provides voice-forward, real-time visual interpretation for people who are blind, have low vision, or prefer intuitive visual assistance. This technology, developed in close collaboration with the accessibility community, turns Gemini into a conversational visual partner. It was trained using tens of thousands of hours of data, with the help of Aira, and refined through the Trusted Tester network and Aira specialists.

With Guided Vision, users can simply share their camera during a Gemini Live session to receive clear descriptions of their surroundings, ask detailed follow-up questions, and receive proactive spoken cues to reframe their perspective. This assistive technology helps users locate objects, prepare meals, or pick outfits by providing quick visual verification. It also benefits older adults, individuals with low literacy, and anyone needing to read fine print in low light.

However, Guided Vision is not a medical device, mobility aid, or white cane replacement. It's not intended for navigation, safe-travel guidance, or obstacle detection. Users should still rely on established mobility aids and safe-travel practices. The technology is available on Android devices running Android 9 and above, with compatible regions and languages. Ensure your Gemini app and Android system software are updated to access this feature.