Anthropic releases computer use for Claude 3.5 Sonnet
Confirmed
Importance: major (4 of 5)The takeaway
Anthropic’s upgraded Claude 3.5 Sonnet became the first frontier model offered with ‘computer use’ in public beta — operating a computer by viewing screenshots and moving the cursor, clicking and typing.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- Major (4 of 5)
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- Announced 22 October 2024 alongside Claude 3.5 Haiku
- OSWorld (screenshot-only): 14.9% vs. 7.8% for the next-best system, per Anthropic
- SWE-bench Verified: 49.0% for upgraded Claude 3.5 Sonnet
- Available via API as a public beta
What happened
Developers could direct Claude to use desktop software through a general-purpose GUI interface rather than bespoke APIs.
Why it matters
Launched GUI agents at the frontier; OpenAI’s Operator and Google’s Project Mariner followed within months.
Sources
2 sources from 1 site. Numbers match the chips in the text.
2 sources: 2 primary
Primary
- Introducing computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku (Anthropic)anthropic.com, official
- Developing a computer use model (Anthropic)anthropic.com, official
Changes
- Filed