{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-10-01-gemini-live-guided-vision/","md":"https://postcutoff.com/e/2026-10-01-gemini-live-guided-vision/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-10-01-gemini-live-guided-vision","date":"2026-10-01","date_precision":"day","short_title":"Google adds Guided Vision to Gemini Live","deck":"Real-time spoken scene guidance for blind and low-vision users on Android","takeaway":"On Oct 1, 2026 Google launched Guided Vision in Gemini Live, a camera mode that gives blind and low-vision users live audio descriptions and spoken cues for re-aiming the phone (\"verbal reframing\") while they explore their surroundings.","category":"product","category_label":"Products","importance":2,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"Google blog: Guided Vision in Gemini Live, built for accessibility","url":"https://blog.google/innovation-and-ai/products/gemini-app/guided-vision-gemini-live/","type":"official","group":"primary","domain":"blog.google"}],"official":1,"filed":"2026-10-02","updated":"2026-10-02","orgs":["Google"],"title":"Google adds Guided Vision to Gemini Live: real-time spoken scene guidance for blind and low-vision users on Android","summary":"On Oct 1, 2026 Google launched Guided Vision in Gemini Live, a camera mode that gives blind and low-vision users live audio descriptions and spoken cues for re-aiming the phone (\"verbal reframing\") while they explore their surroundings. It runs on Android 9+ wherever Gemini Live is available and was built with the visual-interpretation service Aira.","key_facts":["Conversational, real-time visual assistance: dynamic audio descriptions plus spoken cues to reframe the camera","Built for people who are blind or have low vision; Google says it also helps older adults and anyone in low light","Android 9 and above; available wherever Gemini Live is supported; tested in India, Brazil, Singapore, Indonesia and Japan","Access via Gemini app settings, Android Accessibility Shortcuts or TalkBack","Partner Aira: its Trusted Tester network (1,000+ members) and specialists contributed tens of thousands of hours of visual-interpretation data and helped set safety guardrails","Google does not name the underlying Gemini model"],"key_numbers":[],"tags":["accessibility","gemini","gemini-live","vision","android","assistive-tech"],"science":null,"body_md":"## What happened\n\nGoogle turned Gemini Live's camera sharing into an assistive mode. Instead of answering one-off questions about a frame, the assistant keeps\ndescribing the scene and tells the user how to move the phone to capture what they are looking for.\n\n## Why it matters\n\nLive multimodal assistants are taking over some tasks that used to need a human describer. Here a human visual-interpreter service, Aira,\nsupplied the training data and helped set the guardrails.","disputed":[],"related":[],"people":[],"posts":[],"videos":[],"models":[],"changes":[{"date":"2026-10-02","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-10-02","run":null,"sources_read":null,"updated":"2026-10-02","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":123,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":93,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":184,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":123,"in_training_data":false}],"short_url":null}