Yeah he seemed too reasonable to me, relative to the fervor. Whoever ends up in charge needs to do a lot of frothing to catch up to the ferver that would justify their valuations and investments
Yeah he seemed too reasonable to me, relative to the fervor. Whoever ends up in charge needs to do a lot of frothing to catch up to the ferver that would justify their valuations and investments
Can you explain this more precisely?
https://endpoints.news/demis-hassabis-leaning-into-isomorphi...
IDK, haven't Google been putting Gemini front and centre in pretty much all of their products?
I'm seeing Gemini on my slide decks, Gemini on my e-mails, Gemini on my searches, Gemini on my videoconferences, Gemini on my database query console. My impression was they were doing a Google Plus style attempt to marshal all the company's efforts behind one product.
Maybe this isn't the same as the eight figure comp they'd get at Meta when they did their hiring spree, but no one thinks that's sustainable.
I don't get the impression that the difference between one company succeeding to build SOTA LLMs, and another struggling, comes down to individual employees - it seems to be more about the organization itself and their ability to manage teams and projects of this type. No doubt there are a few rockstars generating huge value, such as Noam Shazeer had been, but they are the exceptions.
When DeepMind was first created, before Google acquired it, they were famous for the high salaries, especially for the UK, but this was an assemblage of the brightest and best PhDs, expected to be solving challenging research problems along the unknown path to AGI. Many of these original employees may still be there, but it seems their job and value proposition has changed - are they any more capable, or key to, helping Gemini catch up with the competition than some "rank and file" employee familiar with LLMs? And if so, why haven't they done it?
I'm honestly not sure about that. They need a decent LLM to fight off the threat of LLMs replacing search, but I'd say that Gemini 3.6 Flash is more than good enough for that, with a smaller/cheaper model being preferred to a larger one. If you are "searching" for a proof to the Jacobian conjecture, then try Fable, and I doubt Google will miss the advertising revenue if Anthropic manage to sell Terrance Tao a pair of socks.
More to the point, DeepMind seems to have become a product division charged with building LLMs, not a blue sky research institute chasing AGI. To the extent that continued LLM improvement is important to Google, the relevant question is how much do you need to pay for a competent ML/LLM developer?
>you sound like an MBA
Well, no - techie here.
I wasn't sure if you were suggesting that DeepMind should pay more just because people developing LLMs at other companies are paid more, or because these are elite DeepMind researchers and are objectively worth more than other Google developers. My point being that it seems they are no longer being used as elite researchers - they are LLM developers. Does Meta need to pay FAANG salaries to employees that have been repurposed as data labellers?
i know people at deep mind, its impacting their ability to deliver good products
If the goal is to maximize share price (which it is) this is probably the safest approach. Why do they have to keep chasing developing the best model when they can
a) charge everyone for the cloud infra
b) have a "good enough" experience for normal consumers
Their current setup will be worth trillions. Already is. Let anthropic get paid for the most expensive queries while they get a bill from Google for their cloud/TPU use. GCP grew 82% YOY with 24B revenue and improving margins. So GCP became a 100B business. Anyone doubts it's gonna double in less than 5 years? Gemini just needs to be good enough for normal folks who want personal agents for everyday use. I don't think Google has to compete with Anthropic on making the best agentic programming model.
Real scientists are skeptical. Wall St and the people who serve it don’t like that.
I don't get the impression from interviews that Kavukcuoglu is that guy - he seems like a safe pair of hands, but not someone that is on a mission.
OTOH I don't even think this is the right race to be in.