I Tested NEW Gemini 4 Argon on 23 Coding Prompts

Summary
Povilas Korop from AI Coding Daily evaluates Google DeepMind’s newly released Gemini 4 Argon across his standardized benchmark of 23 coding evaluation prompts. He analyzes the model’s availability, high inference and subscription costs, execution speeds, and benchmark performance across Laravel, React/TypeScript, bug detection, and edge-case testing, before revealing its placement on his LLM coding leaderboard.

What is shown

• [00:00] Sundar Pichai’s official post announcing the global release of Gemini 4 Argon across the Gemini API, Gemini platform, and Antigravity for Ultra subscribers.
• [00:43] Google’s Gemini pricing page detailing the differences between Google AI Pro ($19.99/month) and Google AI Ultra ($99.99/month).
• [01:33] Announcements from alternative providers making Gemini 4 Argon accessible, including OpenRouter, Cognition (Devin), and OpenCode.
• [01:56] Terminal execution logs of benchmark runs via OpenRouter, highlighting token limits, execution durations (6–8 minutes), and high per-prompt costs ($0.796 to $0.935).
• [02:55] Devin UI and terminal logs displaying quota exhaustion warnings (hitting 98% daily quota) during evaluation runs.
• [04:43] Terminal outputs showing test passes and failures, including edge-case failures on non-CSV file validation in a PHP import task and timeouts exceeding 15 minutes.
• [06:06] Output from a bug-finding evaluation showing Gemini 4 Argon identified 16 total bugs (11 natural, 5 speculative), earning a score of 71.9/100 (7.19 points).
• [06:47] The updated AI Coding Daily LLM Coding Leaderboard (dated October 14, 2026), placing Gemini 4 Argon (High) at rank #18 with 57.09 total points.
• [07:47] Community benchmarks on X from Paweł Huryn (33 bugs fixed vs. GPT-6 Astra’s 45) and Theo (codebase analysis bench score of 3.95 with >50% false claim rate).
• [09:22] Excerpt from Google’s official announcement post indicating Gemini 4 Argon is the first model in an upcoming Gemini 4 family.

Claims & numbers

• The presenter says Gemini 4 Argon in Google Antigravity is restricted exclusively to Google AI Ultra subscribers ($99.99/month), excluding Google AI Pro ($19.99/month) users [00:36].
• The presenter notes Cognition offered a 75% promotional discount on Gemini 4 Argon for Devin users through October 27 [01:38, 03:09].
• On OpenRouter, running Gemini 4 Argon at high effort cost between $0.796 and $0.935 per prompt [02:16, 02:42].
• Evaluation runs took 6 to over 15 minutes per prompt, requiring the presenter to increase execution timeouts from 15 to 30 minutes [02:40, 04:54, 05:04].
• In the bug-finding test against 21 planted bugs, the presenter states Gemini 4 Argon found 16 total bugs (11 out of 16 natural bugs), receiving a score of 7.19 out of 10 [06:12].
• On the AI Coding Daily leaderboard, Gemini 4 Argon (High effort) scored 57.09 total points (#18 overall): 17.15/20 on Laravel Code Quality, 18.5/20 on React/TS Code Quality, 7.19/10 on Bug Finding, and 14.25/20 on Edge-Case Testing [07:04].
• The presenter points out that Claude Haiku 5.5 (Medium) outscored Gemini 4 Argon on the leaderboard (scoring 58.07 at #16) [07:11].
• Citing Paweł Huryn’s benchmark, the presenter notes Gemini 4 Argon fixed 33 bugs out of 45 maximum, trailing GPT-6 Astra (45), Claude Fable 5.1 (43), and Claude Opus 5.5 (41.7) [07:56].
• Citing Theo’s codebase analysis benchmark, the presenter states Gemini 4 Argon placed last with a weighted score of 3.95 and a false claim rate over 50% [08:09].

Notable quotes

• “Argon was maybe named after the fact that your tokens are gone really fast.” [04:26]
• “If you ask Argon to generate some code, you will get pretty average result for really high price.” [07:40]
• “Google is now back in the game, back in the race as average model for coding...” [08:28]

Assessment
This is an authentic, independent benchmark review video demonstrating real evaluation runs and command-line execution logs across multiple developer tools. The presenter provides verifiable test results and leaderboard statistics, though he relies on third-party API wrappers (OpenRouter and Devin) rather than Google Antigravity due to subscription-tier restrictions.

Described by gemini-3.8-flash on 2026-10-14 from the video’s audio and frames.