Gemini 4 Argon
deepmind.google
deepmind.google
Google's major releases have usually done pretty well on our benchmarks because they're good at hard problems and open-ended decision making (with a well specified prompt), which obviously doesn't always translate to user experience. In particular, older Google models struggled to work efficiently in a harness. They seem to have solved that with Argon.
We did see a new problem which I hope they can fix. This is the first near-frontier model we've caught in infinite reasoning loops in a long time. We also saw a few examples of it failing to properly delineate reasoning blocks, so it has a higher failure rate than its competitors.
My overall impression is that Argon is a near-frontier model for engineering design, code analysis, and chat. It definitely has the intelligence to be a competitive coding assistant product, but a good coding assistant needs to be polished, so I hope they can clean up the CoT bugs.
Data at https://gertlabs.com/rankings
Depends on where you draw the line for "near frontier model", but the current leading open-weights model, MiMo-v2.6, has exactly this problem. They released a fix on Hugging Face[1], but as of two days ago the model available via Xiaomi's own API still sticks in reasoning loops.
This seems to be such a Google thing. Anyone who has used Gemini for long enough has encountered these 'She loves me, She loves me not' spam loops
This is a clear step change, I'm genuinely amazed.
Its answers are to-the-point, logically structured, clearly written. Like a really well made mini essay on your question.
It also really likes to build little simulations / models that you can tweak the parameters on. Amazing to explore how different assumptions affect economic scenarios, for example.
It's also great at picking (sourced) illustrations.
I'll be using this for everything that isn't coding from now on.
As an example, I recently had an OCT scan of my retina because I'm a “glaucoma suspect.” I'm a glaucoma suspect because I have an unusually high cup-to-disc ratio, which is a pattern typically seen in glaucomatous patients.
As part of this OCT scan, you get a report back on your RNFL, which is basically a report on the health and thickness of your optic nerve(s) and retina(s). (Dramatically oversimplifying, of course.)
My ophthalmologist struggled to explain my OCT scan results to me and instead sort of shrugged and said, "It's probably because you're a high myope, but we'll keep you coming in once a year.”
But my scans look horrifically bright red — meaning I'm in less than the first percentile of retinal thickness for my age. Obviously concerning enough to do my own research…
ChatGPT 6 Pro and Opus 5.5 have struggled to make any sense of the clinical implications of these scans. In contrast, Argon was the first model to:
1. explain how the OCT machine works
2. detail the physiological mechanism that causes the cupping and thinner RNFL layers in my scenario
3. sum it up into a clinical recommendation (similar to what my ophthalmologist recommended, with the addition of basic supplementation and lifestyle modification changes)
4. provide an interactive visualization of the topography of my eye vs a glaucomatic eye: https://optic-nerve-3d.netlify.app/
I'm blown away.
why? is it not so good on that? or is there something better performance, or better price for same performance?
I've actually spent some effort trying to make them halfway decent placeholders by putting together a skill based on diataxis framework (https://diataxis.fr/) that at least got everything into the right location
just took a pass at rewriting them w/ argon and am very pleased, big improvement
I've been trying it out via the API and the model has been a delight so far. Clear in the head, not RL-fried, distinct writing style, and big model smell. That said, the em-dash is back w/ this model.
That said, I would be so frustrated with Sundar Pichai if I was on the Google team. The botched rollout of this model seems to be entirely a matter of capacity, and Pichai has been more than happy to give it to anybody but his own team.
I'm not entirely sure you're correct. Your claim boils down to "Writing natural human prose" vs "Broad use of complex software and spatial awareness". My gut feeling is that there's more untapped and fruitful applications in the second group than the first - at least in the short term.
The results are a bit disappointing given Googles scale and training data.
The results are on par with cheaper Chinese open source models to be frank. https://cliphou.se/benchmark/
noooooooo
Given FelonyBench, do we also have a FantasyBench?
- Natively multi-modality
- Enormous context windows
- Reliably cheap prices
It's like they don't release a model until it passes the above checklist.
Most providers have some mixture of these three occasionally, but with Google, every model is consistent. This kind of consistency is really nice to have.
Outside of that, behavior is quite good, a bit slow, and definitely different than both GPTs and Claudes -- which is appreciated.
do you have to pay those cheap prices eventually or can you just accrue an unlimited amount of overdue charges?
https://arena.ai/leaderboard/agent/chat/pareto
For almost same intelligence (+15.56%, +15.18%), drastic difference in cost/task ($3.51 vs $0.41)
For chat, yes. But switch to code on the same page, and the picture changes. OpenAI takes the lead.
Argon build: https://html.non.io/lcars-argon/
GPT 6.1 sol: https://html.non.io/lcars-gpt-6.1-sol/
Opus 5.5 (currently SOTA for this): https://html.non.io/lcars-opus-5.5/
Original designs: https://diffui.ai/app/canvas/5093e689-1e74-4f26-b632-2a4500f...
(Chrome, also incognito)
https://dach.peerbench.ai/compare?models=google%2Fgemini-4-a...
State of affairs [1]:
> My whole project and career depended on the 3.1 pro workflow. Please, bring it back
[1] https://discuss.ai.google.dev/t/please-bring-gemini-3-1-pro-...
But id the progress of decoding it is legit, you should write something properly about it!
What kind of progress was made with Argon with the Voynich?
It looks like you've managed to decode it? Is that legit?
https://www.bridgebench.ai/nerf-bench
https://marginlab.ai/trackers/claude-code/ https://marginlab.ai/trackers/codex/
Since then they cut the price but the intelligence (of 6 and 6.1) has gone down to Sonnet 4 levels. I am back in a world where the model is lazy, cuts corners, ignores existing coding standards and context, makes stupid mistakes etc.
I am not sure how those models still rank so high in benchmarks when real-life usage is so obviously bad.
It thinks a ton, ~24k output tokens a run vs ~3k for Sonnet. It missed a solution by thinking its way into a 10 min timeoout.
Something to look out for - if you're using pi, it doesn't have Argon in its catalog yet and reports cost at Kimi's rates, about a third of what OpenRouter actually bills.
This is crazy if it can work accurately.
I’ve tried the various alternatives (opencode, pi.dev) but for “have several physical machines, each running an orchestrator and 5-10 agents, and each agent spawning its own subagents to do work in parallel, all of that on a tanky GitHub project boards” level of work only Claude was doing work dependably.
I can have a few orchestrator leads which I talk to and brainstorm, and let them file tickets, organize them and assemble teams of agents to work of the various problems. And all of that with just a smidge of custom tooling on top of Claude Code’s default.
Plus don’t have a budget to spin all of this on cloud runners so I made sure to do as much as I can with local work on several machines I own. Was quite easy to achieve with Claude.
Do you have something similar built on top of a open source harness, or is it from scratch?
We won't know the answer to this until IPO and until each company reveals the economics of their models (training and serving).
Here's low, medium, high. Even low is better than pelicans from any other lab: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
low cost 10.185 cents, medium was 11.098 cents, high was 17.166 cents.
The costs are similar because it used more output tokens than reasoning tokens for all three pelicans, even for high.
> If it's on HN and is a meme at this point, it will end up in the training set.
> It's kind of fun to imagine that there is an intern in every AI company furiously trying to get nice looking svg pelicans on bicycles.
Google listened and assigned a few interns, I guess, for the task
This is the sheet: https://fernandoipar.com/content/music/poly-d/gemini-argon/c... (the annotations on it are by me)
And this is what Argon created: https://fernandoipar.com/content/music/poly-d/gemini-argon/b...
For this simple prompt: https://fernandoipar.com/content/music/poly-d/gemini-argon/p...
I'm honestly impressed.
Subtle highlights on the metal frame, sweat beads, jaunty little hat…it has style. At least compared to the rather literal ChatGPT outputs. https://static.simonwillison.net/static/2026/gpt-pelicans-gr...
I note that even these bikes are not actually rideable. For a bike to be stable, the front wheel axle needs to extend forward a little ahead of the fork - the fork must ”bend forwards”. This is what actually keeps the bike upright, not gyroscopic effects or some such. Given LLMs are generally good at basic maths, im surprised they get this wrong.
Maybe a bit less so in this case though. As per the announcements, the model was actually trained for this prompt, so was fed some training data. I can well imagine the data there was just not so good.
https://en.wikipedia.org/wiki/Pelican#/media/File:Pelikan_Wa...
Argon: https://jonclegg.github.io/pacman-bakeoff/dev/#gemini-4-argo...
Opus 5.5 https://jonclegg.github.io/pacman-bakeoff/dev/#claude-opus-5...
Also, that first tweet contains a commentary that, for me, explain a lot about the public misconception about how current AI works:
> wait, does this mean you guys are actively training svg generation? i was mostly amazed by it thinking the models doing better at it by itself due to becoming better at reasoning.
No, it's not better reasoning that drives current AI, it's better examples we have been giving them. Whole army of people generating content for the frontier labs.
Also, reasoning improving the out of distribution part, like computer use, tool use etc.
It's a simple manner of prompt...generate concept art with nanobanana, measure, llm creates svg with text, measure the distance between rasterized svg embedding to nanobanana art....do post-training RL on a 3 million such images and matching embeddings.
I swear this will be a canonical example of Goodhardt's Law in action.
You have to switch to a new benchmark that isn't so easy to run a verifiable rewards pipeline on...Perhaps a longer horizon task where it's easy to mess up midway.
As one point, the high pelican's arm is see-through/messed up.
They do look worlds better than previously, to be fair.
Modern models can make nearly photorealistic games in threejs. So why do they struggle with these pelicans?
wasn't the whole point of pelicans is that labs *wouldn't* train for that?
so now the benchmark is ruined
<https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...> <https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...>
- I was having trouble embedding the SVGs as links, and ChatGPT recommended Simon Willison's SVG Renderer as a workaround.
Just my 2 cents on the pelicans benchmark: I think it might help if you were a bit more explicit about not taking this one benchmark too seriously. I know you say that at times, but at other times (such as the comment I'm replying to) you elide it which can read as a seriousness about the benchmark.
Give me reverse engineering bench and agentic coding.
Leave making visuals to humans who actually have aesthetic sense unlike whatever made this mess
Google's years of research project into Indic scripts, image trainings, translation efforts & transliteration efforts is literally paying off. The AI adoption from non-English, non-Chinese population will only if you have these contextual localisations, which I think Gemini is poised to do well.
For example, you can ask for a shopping list for a marriage function in a town from Tamil nadu (the marriage custom varies by districts), and Gemini provides contextual and helpful answer (like what is the custom followed there, what is gifted traditionally, etc), whereas if you ask Claude/ChatGPT, it talks about marriage registeries or pretty generalised answers which is not relevant or useful.
Pretty misleading.
Seems to be just deleting anything that a safety filter triggers on. I don't know if I like this more or less than what Anthropic does where they train the model to actively refuse.
Even after using the free model in Google search talking to Anthropic or OpenAI models feels like talking to an ox.
Excellent model. Same price and score as Opus 5.5 in our 23 question exam.
This size / class of model is now a bit overpowered for these short-horizon data analytics tasks. OpenAI 6.1-Sol, Haiku 5.5, GLM 5.3 Flash all achieve about the same results but for ~1/10th the cost.
In other words, we're getting to the stage where models are "good enough" for certain tasks like data analytics and competitiveness is going towards size & speed.
As of my knowledge cutoff, three of the top state-of-the-art large language models are Google's Gemini 2.5 Pro, OpenAI's o3 (and GPT-4.5), and Anthropic's Claude 3.7 Sonnet.
And at least Flash 3.7/3.8 were both difficult to persuade that they have wrong knowledge cutoff.
I reported it as a bug to Google, but as all of my reporting to Google, no response ever. This is just stupid!
Very fast.
Makes mistakes. Corrects the mistakes quickly with direction.
Google Argon 4: https://share.gemini.google/T9r6tr2dDaTE
I didn't have time to make it into a full blog post yet. Here is a previous one.
https://generative-ai.review/2026/07/kimi-k3-rush-test-vs-cl...
Astra 6 is significantly better than Google Argon 4 and a lot better than Claude Fable
https://generative-ai.review/2026/10/catchup-openai-astra-6-...
(edited thanks to tekacs)
- Try in Gemini
- Try in Google AI Studio
- Try in Google Antigravity
Will non users of Google products even know what these three things even are?
Is there anybody in Google having a look at how bad and complicated their payment system is? In all the other AI providers you just sign in, pay, get a key, done. In other clouds like AWS, you add a card, pay little to verify the card the first time, monthly bill, done. In Google it looks like you have to fight them every time for the very thing they should make as easy as possible: opening your wallet.
is it just 'Hire the right people'?
Couldn't you just say what the price will be after the introductory period and when it'll take effect? Do they have some SKILL.md for these blog posts that requires the most important information to always be buried ten levels deep and hidden behind a login page?
Claude Opus 5.5 58.7%
Gemini 4 Argon 47.1%
Claude Fable 5.1 46.7%
Benchmarks: https://bench.killswitch-lang.org/Language info: https://killswitch-lang.org/
"Across Google", wonder how much that is because of an effort by Google to curb usage of Anthropic models. MSFT and Meta similarly are pushing for in-house models. It doesn't mean the models are better when you push your engineers to dogfood and restrict access to other LLMs.
(Not that I know for sure this is the case, it's more of a hypothesis).
Unavailable · Gemini 4 Argon is currently available to Ultra plan subscribers.
But on December 1st Argon doubles in price - so it will be the same price as Opus 5.5.
Edit: noble gases not noble taxes, though the latter would be a funnier naming scheme.
It feels so complicated and hard to know what we can use vs what hands them our codebases
Is it actually available?
The code is bad though.
I'm starting to feel the subscription fatigue and a small amount of FOMO. I just can't justify pro accounts for every frontier model now that it includes OpenAI, Anthropic, Meta and Google.
build this scene space station docking scene https://x.com/_satyam_ai/status/2110097633922662752?s=20
Gemini 3 Flash was around 0.403, 2.5 Pro was around 0.34.
Every time I try to generate one it's like a slot machine, where a different part will be messed up after fixing the first.
I wonder if any of the AI safety people will begin encouraging AI researchers to swap jobs to work at a failing lab in order to keep them all extremely competitive with one another.
It still thinks Charlie Kirk is alive, though.
What about the Google One AI plans? Will they get it? That has a Pro AI plan as well.
"Hans, we're doing a new point release! What isn't crossed out on the periodic table yet?"
On safari the page doesn't scroll very well on the first section
Which one is it?
e.g.
X: The Parameters
Y: The "System"
Z: The "Ongoing Grind"
The first two prompts I tested in AI Studio does the same, unfortunately.Another quite unpleasant tick was that if you specify a peculiar term in your prompt as a conversational shortcut, it would keep repeating that throughout the conversation. e.g. "...What is a bitter lesson pilled way to do this?", then you'd see it will quote "bitter lesson pilled" at like 7 places in its response. This one seems to have eased off a little.
[1] https://github.com/srw/sha256-19step-preimages-with-padding
[2] https://github.com/srw/sha256-20step-preimages-with-no-paddi...
I asked for a QUICK healthcheck on the sync status of a bigquery integration. It literally spun for 25m before I killed it.
The task, which is CLEARLY outlined in the agent readmes just involved using the gcloud cli to initiate auth, then just run a few queries to check logs and timestamps.
Even 3.6 flash can get this right (most the time).
That was a long wait.
What’s the point lol. I’m not subbing to ultra to have it
Without going into details, for a small part of a larger task, I asked it to classify different content types of different files and formulate a structured mapping (e.g., in JSON) between content types and another set of files (deliberately left vague here but not to Argon) from my codebase. I even offered it a multi-part draft of a classification system to start with and told it that if it can find other classification systems from international standards, academia or industry more suitable to the task than my rough draft, we can discuss replacing my suggestion. There were other parts to the instructions too, written out like an article with bulleted lists, precise program-like wording, etc. Then, I sent the prompt and left for a while.
When I came back, it was nearly done with the implementation but the classification system it came up with was a mess. It even admitted to making up "bogus" classification standards when I pointed out some errors. It also kept leaving gaps multiple times when I referenced errors to fix in subsequent instructions (and not once apologized the entire time lol). So my first impression was subpar, not really comparable IMO with Opus >=5 or Sol >=6, and seemed to leave larger gaps than 3.8 flash typically does. The most irritating part to me was not only the fact that it was making up things, but that it ignored my instructions to discuss things with me before deciding to shift away from my draft; I don't recall any major LLM ignoring an instruction like that in at least a year.
OpenAI release any time now
I have found that Gemini often claims it did something, but didn't actually complete the task.
I just had 3.8 Flash do a major refactor -- that never should have needed to be done in the first place -- and switched to Argon 4, and had it review it.
Almost everything had been stubbed out by 3.8, and none of it was properly integrated into the codebase. :facepalm:
fyi: argon is an interesting choice of name, coming from the Greek argos meaning "lazy or living w/out labor".
Start preparing Gemma 5 release.
Gemini Live vs. Gemini Lite vs. Gemini Pro vs. Gemini Flash vs. Nano Banana Lite (that one apparently has no Gemini prefix?)... Please, just pick a metaphor and stick with it without wildly mixing reasoning modes, model sizes, and input/output modalities in the model name!
Still reading up on it here: https://ai.google.dev/gemini-api/docs/long-decode and needs lots of community testing to determine whether it's a "true" 1M token output window.
Now that needed to be done for some time!
Regardless of if an AI helped or not, regardless of whether that was Google's or some other AI or not (though Argon does sound pretty cool!), regardless of whether an AI cut the time from months to weeks or not, refactoring Chrome -- decomposing it into individual clearly demarcated non-tightly coupled software parts with core webpage handling at the center -- that needed to be done for some time!
Now all of that being said, Gemini 4 Argon does sound pretty cool, and we congratulate both teams at Google -- the team that created Gemini 4 Argon, and the team that refactored Chrome with it!
But all of that being said, while the advancements made for Gemini 4 Argon are important and impressive (and they are!)... refactoring Chrome properly (IMHO) is slightly more important and impressive!
(You know, one man's humble opinion! That is, I am not the guy who is responsible for awarding performance-based bonuses at Google at the end of the year, so take everything I say with the proverbial "grain of salt"! :-) I am probably biased, one way or the other! :-) )
I never touch 3.8, it's awful. Curious to try this, but I've yet to use any Gemini that is good for agentic work.
Also, unrelated but this made me look at Artificial Analysis to see where it lands on Cost per Task, and it ranks Opus 5.5 at almost double Astra 6. That does not align with my experience.
Google...why. You keep getting so close but constantly fumble at the last moment. I can use Opus 5.5 and Sol/Astra on the $20 Anthropic and OpenAI plans.
You are already playing from behind. You need to GET YOUR MODELS INTO MORE PEOPLES HANDS by any means possible. Continuing to make it difficult to use your products DOES NOT HELP.
This model might be great but the majority aren't going to subscribe for $100/month just to try it.
The fact that multiple companies can breach any benchmark means there is no ambiguity in terms of how to build AI, its just a matter of time.
Certainly Meta and Google are benchmaxxing to please public markets, but it still proves the above
Like a working scroll on a webpage.
God damn this is impossible to use of safari mobile.
Now, I happen to believe that's an excellent strategy. I bet they actually resolve more LLM requests than any other company at this point. The lay person still uses Google exclusively.
If they don't want to make it available even for small tests for free, that's fine, but then don't put a button suggesting I can try it without qualifying it...
EDIT: It's actually worse: The page then shows "Look what you can do with Gemini 4" and a "Let's go" button that leads to a bunch of links to examples, all with enticing pictures. Except if I click on them I get a box stat strongly suggests it'll run with Gemini 4, except the dropdown shows "Flash" and if you click on it, it shows as Gemini 3.6 again, and if you run it, the results unsurprisingly end up looking nothing like their pictures.
I don't know if that page was built by humans or AI, but clearly nobody tested it properly.
Me: Gemini, navigate to nearest McDonalds.
Gemini: [Lists 10 McDonalds locations wnd asks which I want.]
Me: What were the priginal instructions just now?
Gemini: [Recites imperatives about tone and content from its memory system.]
Me: No. I told you to navigate to the NEAREST McDonalds. There's only one NEAREST McDonalds. Do that one.
Gemini: My mistake, navigating to the nearest McDonalds. [Opens Maps, navigating to a McDonalds across town.]