---
id: "2026-08-24-artificial-analysis-speech-agent-arena"
url: "https://postcutoff.com/e/2026-08-24-artificial-analysis-speech-agent-arena/"
as_of: "2026-11-13T13:49:00+01:00"
date: "2026-08-24"
date_precision: day
category: benchmark
importance: 2
confidence: high
status: [Confirmed]
sources: 4
editor: human editor
human_review: null
version: "2026-10-04"
---

As of: 2026-11-13 13:49 CET.
Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/
Canonical page: https://postcutoff.com/e/2026-08-24-artificial-analysis-speech-agent-arena/

# Artificial Analysis launches the Speech Agent Arena for speech-to-speech voice agents

On 2026-08-24 Artificial Analysis launched the Speech Agent Arena, where people hold live conversations with two hidden speech-to-speech models across 15 agentic (tool-calling) and 20 non-agentic scenarios, then vote. It reports a preference Elo plus a task-success rate. At launch Gemini 3.1 Flash Live Preview led on preference, and Grok Voice Think Fast 2.0 led on task success (94.7%). It joined AA's 2026 voice leaderboards, which also include the Controlled Voice TTS arena (July 2026) and multilingual TTS arenas (Sept 2026).

## Key facts
- Method: pairwise human votes after separate live conversations → Preference Elo; agentic task success = share of eligible conversations completed with the correct final tool call(s)
- Launch preference Elo: Gemini 3.1 Flash Live Preview (Minimal) 1,046; Gemini 3.1 Flash Live Preview (High) 1,014; OpenAI GPT-Realtime-1.5 1,000
- Launch task success: Grok Voice Think Fast 2.0 (High) 94.7%; OpenAI GPT-Realtime-2.1 (High) 91.5%
- Controlled Voice Arena (announced 2026-07-08): TTS models compared on the same 8 cloned voices (US/UK, male/female). Initial leader Cartesia Sonic 3.5 (1,122), then Eleven v3 (1,088), Inworld Realtime TTS-2 (1,070)
- Multilingual TTS arenas for 9 languages beyond English announced 2026-09-22

## What happened

Artificial Analysis, the independent benchmarking firm, added an arena for end-to-end voice agents. Earlier speech arenas (TTS preference, STT WER) scored single components.
The Speech Agent Arena scores whole conversations with speech-to-speech models, including whether the agent actually did the requested action through tool calls.

## Why it matters

Voice agents are being sold into customer service, where finishing the task matters more than sounding natural. The two launch leaderboards disagree: the preferred-sounding model is not the most reliable one. That split is now measured in public.
Launch rankings were taken from AA's article and will change as models are added.

## Your AI and this story

- GPT-6 Astra (training cutoff April 2026): 116 days after its cutoff
- Claude Opus 5.5 (training cutoff June 2026): 55 days after its cutoff
- Gemini 4 Hydrogen (training cutoff March 2026): 146 days after its cutoff
- Grok 4.7 (training cutoff May 2026): 85 days after its cutoff

## Sources

1. [Artificial Analysis: Announcing the Speech Agent Arena](https://artificialanalysis.ai/articles/announcing-the-speech-agent-arena) (artificialanalysis.ai, official)
2. [Artificial Analysis on X: Controlled Voice Arena announcement](https://x.com/ArtificialAnlys/status/2074886571166462405) (x.com, official)
3. [Artificial Analysis Controlled Voice leaderboard](https://artificialanalysis.ai/text-to-speech/leaderboard/controlled-voice) (artificialanalysis.ai, official)
4. [Artificial Analysis on X: Multilingual TTS Arena leaderboards](https://x.com/ArtificialAnlys/status/2102490340678856997) (x.com, official)

## Changes

- 2026-09-29 (filed): Created (also covers the Controlled Voice and multilingual TTS arenas)

## Related

- 2026-09-28: [ElevenLabs launches Eleven v4 and Eleven v4 Turbo, #1 on Artificial Analysis TTS arena](https://postcutoff.com/e/2026-09-28-elevenlabs-eleven-v4/index.md)
- 2026-08-27: [Cartesia Sonic-3.6 goes GA and tops the Artificial Analysis Speech Arena](https://postcutoff.com/e/2026-08-27-cartesia-sonic-3-6/index.md)
- 2026-07-29: [xAI releases Grok Voice Think Fast 2.0 speech-to-speech model for voice agents](https://postcutoff.com/e/2026-07-29-grok-voice-think-fast-2/index.md)
- Archived: 2 posts, listed in https://postcutoff.com/e/2026-08-24-artificial-analysis-speech-agent-arena/index.json