Well I asked the google AI mode thing what it thinks about your comment and it told me this (edited obviously):

"10 Quadrillion tokens a month means: 333 Trillion tokens per day and 3.85 Billion tokens generated/processed every single second, 24/7."

"At an incredibly cheap, subsidized infrastructure cost of $1 per million tokens, serving 10 Quadrillion tokens would cost Anthropic $10 Billion per month ($120 Billion a year) just in inference compute."

It also had this to say about how google's AI overview works: "Google doesn't just feed the LLM your 5-word search query. The system scrapes the top 10–20 web results, feeds thousands of words (tens of thousands of tokens of context) into the model, processes it, and then outputs the result."

Oh, and it does all of that in less than two seconds. Honestly, whatever Google is doing with its infrastructure is so far ahead of everyone else, I can't believe you fell for such an obvious lie.

There are also extremely obvious holes in your comment:

>Let's assume Google serves AI overviews on every SERP (they don't) and don't cache them (they do, afiak).

Try it out for yourself. Add a few random letters or punctuation. They cache nothing.