Project Pilot: Anthropic and Andon Labs test whether AI models can fly a surveillance drone (Drone-Bench)
On July 24, 2026 Anthropic's Frontier Red Team and Andon Labs published Project Pilot, which tested 15 models from three developers on autonomously coding and flying an indoor drone to find and follow a person. Claude Fable 5 beat the human-AI team baseline on four of five subtasks and failed only 3D reconstruction. Andon Labs released Drone-Bench as an independent benchmark based on the project.
Key facts
- Five subtasks: reconstruct a 3D model of the office, localize the drone, navigate between rooms, detect the target person, follow them
- 15 models from three developers (including GPT-4o, o1, o3, Claude Opus and Gemini models) tested
- Best model, Claude Fable 5, beat the baseline on 4 of 5 subtasks; models were best at detection/following and worst at reconstruction (~47% of baseline)
- Per Anthropic, consistency lags peak capability by about six months
- Example: Fable 5 estimated camera tilt within four degrees by analysing floor grout lines
- Limits: one office, slow speeds, few people, no outdoor conditions
What happened
Andon Labs (known for the Claude vending-machine experiments) built the drone setup with Anthropic. Models wrote code to control an inexpensive indoor drone and were scored on each step of a find-and-follow surveillance task.
Why it matters
Autonomous aerial surveillance is a clearly dual-use capability, and the study suggests frontier models were close to it by mid-2026, except for 3D mapping. It is a forerunner of the Frontier Red Team's September study of targeting and drone weapons.
Changelog
- 2026-10-01: created (leads run, from the Anthropic uncited-posts audit)
Related posts (1)
- Andon Labs original ↗ Andon Labs @andonlabs · x · 2026-07-24
Cited as a source by: 2026-07-24-anthropic-andon-project-pilot-drone-bench
Related events
- Anthropic Frontier Red Team: frontier models reach superhuman photo geolocation and can write working drone strike software ★★★
- Anthropic's 'Claude plays robotics': LLMs fail at direct joint control but succeed when supervising controllers ★★
- Anthropic releases Claude Fable 5 and Claude Mythos 5 — first generally available Mythos-class model ★★★★★
Sources (3)
- officialAnthropic: Project Pilot: Can AI models fly drones?
- officialAndon Labs on X: introducing Drone-Bench
- pressResultsense: AI models close in on autonomous drone control
id: 2026-07-24-anthropic-andon-project-pilot-drone-bench · updated 2026-10-01 · open in the interactive timeline