This is not really true. Google has all the compute but in many dimensions they lag behind GPT-5 class (catching up, but it has not been a given).
Amazon itself did try to train a model (so did Meta) and had limited success.
It is. It's wild to me that all these VCs pouring money into AI companies don't know what a value-chain is.
Tokens are the bottom of the value-chain; it's where the lowest margins exist because the product at that level is a widely available commodity.
I wrote about this already (shameless plug: https://www.rundata.co.za/blog/index.html?the-ai-value-chain )
I tend personally to stick with ChatGPT most of the time, but only because I prefer the "tone" of the thing somehow. If you forced me to move to Gemini tomorrow I wouldn't be particularly upset.
Gemini holds indeed the top spot, but I feel you framed your response quite well: they are all broadly comparable. The difference in the synthetic benchmark from the top spot and the 20th spot was something like 57 points on a scale of 0-1500
Outside of computer, "the moat" is also data to train on. That's an even wider moat. Now, google has all the data. Data no one else has or ever will have. If anything, I'd expect them to outclass everyone by a fat margin. I think we're seeing that on video however.
Yeah, Google totally has a moat. Them saying that they have no moat doesn't magically make that moat go away.
They also own the entire vertical which none of the competitors do - all their competitors have to buy compute from someone who makes a profit just on compute (Nvidia, for example). Google owns the entire vertical, from silicon to end-user.
It would be crazy if they can't make this work.
Google theoretically has reddit access. I wonder if they have sort of an internet archive - data unpolutted by LLMs
On a side note, funny how all the companies seem to train on book archivr which they just downloaded from the internet
And privacy policies that are actually limiting what information gets used in what.
Tin foil hat time:
- If you were a God and you wanted to create an ideal situation for the arrival of AI
- It would make sense to precede it with a social media phenomena that introduces mass scale normalization of sharing of personal information
Yes, that would be ideal …
People can’t stop sharing and creating data on anything, for awhile now. It’s a perfect situation for AI as an independent, uncontrollable force.
Garbage in. Garbage out.
There has never been a better time to produce an AI that mimics a racist uneducated teenager.
I don't know what you are talking about. I use Gemini on a daily basis and I honestly can't tell a difference.
We are at a point where training corpus and hallucinations makes more of a difference than "model class".
xAI seems to be the exception, not the rule
Right now the delay for Google's AI coding assistant is high enough for humans to context switch and do something else while waiting. Particularly since one of the main features of AI code assistants is rapid iteration.