Google adds Guided Vision to Gemini Live: real-time spoken scene guidance for blind and low-vision users on Android
On Oct 1, 2026 Google launched Guided Vision in Gemini Live, a camera mode that gives blind and low-vision users live audio descriptions and spoken cues for re-aiming the phone ("verbal reframing") while they explore their surroundings. It runs on Android 9+ wherever Gemini Live is available and was built with the visual-interpretation service Aira.
Key facts
- Conversational, real-time visual assistance: dynamic audio descriptions plus spoken cues to reframe the camera
- Built for people who are blind or have low vision; Google says it also helps older adults and anyone in low light
- Android 9 and above; available wherever Gemini Live is supported; tested in India, Brazil, Singapore, Indonesia and Japan
- Access via Gemini app settings, Android Accessibility Shortcuts or TalkBack
- Partner Aira: its Trusted Tester network (1,000+ members) and specialists contributed tens of thousands of hours of visual-interpretation data and helped set safety guardrails
- Google does not name the underlying Gemini model
What happened
Google turned Gemini Live's camera sharing into an assistive mode. Instead of answering one-off questions about a frame, the assistant keeps describing the scene and tells the user how to move the phone to capture what they are looking for.
Why it matters
Live multimodal assistants are taking over some tasks that used to need a human describer. Here a human visual-interpreter service, Aira, supplied the training data and helped set the guardrails.
Changelog
- 2026-10-02: created
Sources (1)
id: 2026-10-01-gemini-live-guided-vision · updated 2026-10-02 · open in the interactive timeline