Post-Cutoff

ResearchMIT93 days after June 2026

Kaiming He’s MIT group: ImageNet pretraining lifts a pure-vision ARC solver to 63.4%

Confirmed

The takeaway

“Natural Image Pretraining Improves Abstract Reasoning” (Ding, Hu, Gan, Yin, Kaiming He; MIT; ECCV 2026) introduces Nat-ARC.

Status
Claim

Confirmed

Our reporting
High confidence
Importance
2 of 5
Last verified
2 October 2026

Your AI and this story

  • GPT-6.2 Astra123 days after its cutoff
  • Claude Opus 5.593 days after its cutoff
  • Gemini 4 Hydrogen184 days after its cutoff
  • Grok 4.7123 days after its cutoff

None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 93 days before it.

Key facts

  • Best ImageNet-MAE-pretrained single model (huge, ~0.6B parameters per QbitAI): 63.4 ± 0.7% pass@2 on ARC-1
  • Prediction-level ensemble of no pretraining, ImageNet MAE pretraining and ARC-style grid pretraining: 70.2 ± 0.6% pass@2 on ARC-1, ‘using a purely vision-based method’
  • ImageNet MAE pretraining improves over matched randomly initialized baselines at base, large and huge scales
  • Predecessor: VARC (‘ARC Is a Vision Problem!’, arXiv 2511.14761, Nov 2025), 60.4% on ARC-1 with an 18M-parameter ViT trained from scratch
  • Tasks helped most involve visual matching, copying and connected-component reasoning (authors’ qualitative analysis)
  • QbitAI’s comparison: LoopViT 65.8%, Loop-OWM 68.5%, and the LLM-based ARChitects (8B) 71.6% (as reported by QbitAI, not checked against the paper’s tables)

What happened

Kaiming He’s group at MIT asked whether visual knowledge from natural photos transfers to ARC’s abstract colored-grid puzzles. They took the VARC pipeline, which treats each ARC task as image-to-image translation with offline training plus per-task test-time training. They replaced its random initialization with an encoder pretrained as a Masked Autoencoder on ImageNet. Pretraining helped at every model scale, and ensembling differently pretrained models reached 70.2% pass@2 on ARC-1 without any language model.

Why it matters

Almost all high ARC-AGI-1 scores come from LLM pipelines. Nat-ARC shows that a small vision-only model with generic visual pretraining gets close, which supports the view that much of ARC is perception plus few-shot adaptation. ARC-1 is now largely saturated by frontier LLMs, and the paper reports no ARC-AGI-2 or ARC-AGI-3 results.

Sources

4 sources from 4 sites. Numbers match the chips in the text.

4 sources: 3 primary, 1 press

Primary

  1. ECCV 2026 poster: Natural Image Pretraining Improves Abstract Reasoningeccv.ecva.net, paper
  2. Paper PDF (ECCV 2026)media.eventhosts.cc, paper
  3. arXiv 2511.14761: ARC Is a Vision Problem! (VARC)arxiv.org, paper

Press

  1. QbitAI: Kaiming He’s team learns ARC from cat pictures (Chinese)qbitai.com, press

Changes

  • Filed (QbitAI)

Status

Claim

Confirmed

Our reporting
High confidence
Importance
2 of 5
Last verified
2 October 2026

Sources at a glance

4 sources: 3 primary, 1 press

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
2 October 2026
Human review
None recorded for this entry. What the editor does
Version
Last saved 7 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

Related events

  1. Benchmarks

    ARC Prize launches ARC-AGI-3, an interactive game benchmark where frontier AI scored under 1%

    Partly confirmed

The whole topic