“Beam 1.0 from @reflection_ai on ARC-AGI (Verified): - ARC-AGI-2: 23.5%, $0.61/task…”
ARC Prize @arcprizeX
Archived text
Beam 1.0 from @reflection_ai on ARC-AGI (Verified):
- ARC-AGI-2: 23.5%, $0.61/task
- ARC-AGI-1: 74.0%, $0.31/task
Beam’s best scores came at xhigh reasoning, but high was close on ARC-AGI-2: 20.0% versus 23.5%, at about 43% lower cost.
