Post-Cutoff

Our testMedium severity

Gemini 3.8 Flash called real, announced Apple products “conceptual product reveals”

“The video is an edited concept presentation styled as an attendee scrubbing through a recorded keynote broadcast.”

Gemini 3.8 Flashgemini-3.8-flash29 September 2026, our test

What was trueIt was Apple’s own recap of its September 2026 event, uploaded by the official Apple channel on 9 September 2026. Source: youtube.com

What happened

This was the second pass. The prompt already told Gemini the date and listed current AI models, but it said nothing about phones. The video was Apple’s own recap, uploaded by the official Apple channel on 2026-09-09: youtube.com (“Apple Event September ‘26: Recapping announcements of iPhone Duo, iPhone 18 Pro, and more”).

Verbatim output (partial context)

This video is a fast-paced social-media-style recap presented by an off-screen narrator scrubbing through a simulated Apple keynote playback. The presenter covers multiple conceptual product reveals, including a foldable “iPhone Duo,” the “iPhone 18 Pro” …

The video is an edited concept presentation styled as an attendee scrubbing through a recorded keynote broadcast.

After the fix

We added headlines of verified 2026 events and the video’s own metadata (uploaded by channel “Apple”, official). The output became:

This video is a fast-paced official Apple recap … reviewing major product reveals from Apple’s September 2026 event. It highlights the foldable iPhone Duo, the iPhone 18 Pro powered by the A20 Pro chip … Assessment: This is an official promotional recap produced by Apple … polished marketing demonstrations rather than live, unedited device captures.

The corrected assessment is still critical in the right way: it flags marketing renders without doubting that the products exist.

Lesson

Grounding has to be broad. Telling a model “AI models after your cutoff are real” doesn’t carry over to phones, watches or anything outside the list. The model still treats whatever it doesn’t recognise as fiction. A post-cutoff briefing should cover the world, not only one domain, and should come with source metadata such as who published the material and when.

Follow-up (2026-09-29)

With broad grounding (date, current models, 2026 headlines, verified channel/date), a second batch of 37 videos, including 28 AI-made music videos full of unfamiliar 2026 references, produced no descriptions doubting that models, products or events are real. Words like “conceptual” appeared only for diagrams and marketing edits.

Related cases

  1. Our testCritical severity

    All four Gemini and Claude runs called the briefing speculative fiction

  2. Our testHigh severity

    Gemini 3.8 Flash labelled real, released models and real events as “fictional”

  3. Our testCritical severity

    Gemini 3.1 Pro declared the whole document ‘unequivocally fiction’ from late 2024 onward

Spotted an error in this case file? Write to contact@postcutoff.com. All cases