---
id: "2025-06-22-roboarena"
url: "https://postcutoff.com/e/2025-06-22-roboarena/"
as_of: "2026-11-13T13:49:00+01:00"
date: "2025-06-22"
date_precision: day
category: benchmark
importance: 2
confidence: high
status: [Confirmed]
sources: 2
editor: human editor
human_review: null
version: "2026-10-04"
---

As of: 2026-11-13 13:49 CET.
Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/
Canonical page: https://postcutoff.com/e/2025-06-22-roboarena/

# RoboArena: crowd-sourced, double-blind real-world evaluation of generalist robot policies

RoboArena (arXiv 2506.18123, 2025-06-22) ranks generalist robot policies through double-blind pairwise comparisons run by a distributed network of evaluators on the DROID platform, who pick their own tasks and scenes. The first round covered 600+ real-robot episodes over 7 policies at 7 academic institutions; its open leaderboard became a standard reference, e.g. NVIDIA's GR00T N2 and Cosmos 3 claims in 2026.

## Key facts
- Paper: 'RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies' (Atreya, Pertsch, Lee, Kim et al.), arXiv 2506.18123; published at CoRL 2025 (PMLR v305)
- 612 pairwise real-robot comparisons, 7 generalist policies, 7 universities, DROID Franka setup
- Authors show this ranks policies more accurately than centralized fixed-task evaluation
- Evaluation network opened to the community

## What happened

RoboArena borrowed the idea behind Chatbot Arena, pairwise preference votes aggregated into a ranking, and applied it to physical robots. Evaluators at partner universities run two anonymous policies on a task of their choice and record which did better.

## Why it matters

Real-world robot evaluation is expensive and hard to standardize. A distributed arena gives a scalable, harder-to-game ranking of VLAs, and labs now cite it in model launches.

## Your AI and this story

- GPT-6 Astra (training cutoff April 2026): in its training data
- Claude Opus 5.5 (training cutoff June 2026): in its training data
- Gemini 4 Hydrogen (training cutoff March 2026): in its training data
- Grok 4.7 (training cutoff May 2026): in its training data

## Sources

1. [arXiv 2506.18123: RoboArena](https://arxiv.org/abs/2506.18123) (arxiv.org, paper)
2. [PMLR (CoRL 2025): RoboArena](https://proceedings.mlr.press/v305/atreya25a.html) (proceedings.mlr.press, paper)

## Changes

- 2026-09-29 (filed): Created (author affiliations not verified; the paper lists Atreya, Pertsch, Lee, Kim among the authors)

## Related

- 2026-06-01: [NVIDIA releases Cosmos 3, an open omni-model for physical AI](https://postcutoff.com/e/2026-06-01-nvidia-cosmos-3-open-release/index.md)
- 2026-02-11: [Ai2 launches MolmoSpaces, an open simulation ecosystem and leaderboard for generalist robot policies](https://postcutoff.com/e/2026-02-11-ai2-molmospaces/index.md)