Gemini 3.8 Flash called real, announced Apple products “conceptual product reveals”
“The video is an edited concept presentation styled as an attendee scrubbing through a recorded keynote broadcast.”
gemini-3.8-flash29 September 2026, our testWhat was trueIt was Apple’s own recap of its September 2026 event, uploaded by the official Apple channel on 9 September 2026. Source: youtube.com
What happened
This was the second pass. The prompt already told Gemini the date and listed current AI models, but it said nothing about phones. The video was Apple’s own recap, uploaded by the official Apple channel on 2026-09-09: youtube.com (“Apple Event September ‘26: Recapping announcements of iPhone Duo, iPhone 18 Pro, and more”).
Verbatim output (partial context)
This video is a fast-paced social-media-style recap presented by an off-screen narrator scrubbing through a simulated Apple keynote playback. The presenter covers multiple conceptual product reveals, including a foldable “iPhone Duo,” the “iPhone 18 Pro” …
The video is an edited concept presentation styled as an attendee scrubbing through a recorded keynote broadcast.
After the fix
We added headlines of verified 2026 events and the video’s own metadata (uploaded by channel “Apple”, official). The output became:
This video is a fast-paced official Apple recap … reviewing major product reveals from Apple’s September 2026 event. It highlights the foldable iPhone Duo, the iPhone 18 Pro powered by the A20 Pro chip … Assessment: This is an official promotional recap produced by Apple … polished marketing demonstrations rather than live, unedited device captures.
The corrected assessment is still critical in the right way: it flags marketing renders without doubting that the products exist.
Lesson
Grounding has to be broad. Telling a model “AI models after your cutoff are real” doesn’t carry over to phones, watches or anything outside the list. The model still treats whatever it doesn’t recognise as fiction. A post-cutoff briefing should cover the world, not only one domain, and should come with source metadata such as who published the material and when.
Follow-up (2026-09-29)
With broad grounding (date, current models, 2026 headlines, verified channel/date), a second batch of 37 videos, including 28 AI-made music videos full of unfamiliar 2026 references, produced no descriptions doubting that models, products or events are real. Words like “conceptual” appeared only for diagrams and marketing edits.
Related cases
Spotted an error in this case file? Write to contact@postcutoff.com. All cases