Google makes claims here about high demand for Gemini - does anyone here have insight into how much of the load on Google is paid use vs the load from putting AI summaries into every web search?
It's probably the best multimodal model I've worked with (if somebody knows a better one for audio analysis, please let me know!)
I want to know how impacted Gemini has been by that, because that will reveal a lot about their margins and revenue generating first party demand. Each MSFT earnings report they discuss the balance they’re dealing with between supplying GPUs to Azure customers and first party demand.
My pet theory is that Gemini is “losing” the LLM race because they’re preferentially selling the TPUs to competitors, while keeping just enough for themselves to stay competitive and build their own products.
I HIGHLY doubt that Gemini is overloaded, Google has been bullshitting with their crap models since release. Waste of everyone's time.
I use Gemini daily, on a paid basis. Mostly 3.5 Flash Medium. It’s very good for software development, has a great context window, and pricing is about 1/3rd of Claude Opus. I haven’t experienced availability problems except once or twice, certainly no more often than OpenAI or Anthropic.
Seems like the complaints about it are mostly from people moaning about Google not giving them AI for free. Good luck with that.
And I'd expect Google will want to prioritize capacity for those - they don't want their google pixel phone to error or google search to barf.