At some point one of these Nvidia doomers will be right but there is a long line of them who failed miserably.
At some point one of these Nvidia doomers will be right but there is a long line of them who failed miserably.
The article explains that Nvidia's biggest customers (50% of datacenter revenue) are switching to their own hardware.
Google runs AI / HPC workloads on their own hardware and has been doing that for more than a decade. Google Gemini was trained on TPUs developed in house. It does not run on Nvidia hardware.
https://www.tomshardware.com/tech-industry/artificial-intell...
https://finance.yahoo.com/news/apple-might-ai-game-1-1951003...
Before that, in a Wired article from 10 years ago about siri and ai, one of the apple higher ups was quoted bragging about having one of the baddest gpu farms around (paraphrasing)
But their internal workloads and their frontier model (Gemini) runs on TPUs.
How does Google pay for TPUs internally? By Google Search and Google Cloud of course. Google Search uses TPUs, Google Cloud however has way more non-TPUs instances.
What people forget, nobody wants to switch from CUDA dependency to SW dependency on Google/AWS/Azure. CUDA at least allows me to use it in consumer, in pro HW, in cloud and AND in on-prem data center.
I'm really looking forward to Fortune 500 companies sending all their internal company data to Google to structure it to train custom AI models. Yeah, that will never happen. What happens instead is that Fortune 500 companies will build up AI expertise to build their own custom AI model and they will think hard if they want the training AI compute internally or on a cloud. Nvidia has a huge business of building data centers on-premises which people totally oversee. NO CSP will ever compete there because it's against their primary business model. A Reliance India contract from 2023 alone is a delivery of 2 million GPUs in a few years. That's probably more than Nvidia's last year's total revenue and that is 1 large corp in India only.
You can argue they won’t, but the “enterprises won’t put sensitive data in Cloud” ship sailed years ago.
Their internal company data is already on cloud servers. They’re not going to waste money on doing it all in house. The executives will buy the AI service from Google/Azure/AWS, where the company data is already hosted, avoid the costs and risk of doing it in house, and collect their bonus.
The article seems focused more on stock price and where to bet, than the market for GPUs or generic hardware vendors.
There's a kernel of truth in it, but if I was McDonalds I'd care a lot more about what KFC is doing than the market trends of cast iron pans.
90% of Nvidia's revenue is from datacenters.
If the datacenters stop buying Nvidia's products, and use their own hardware instead, then Nvidia loses 90% of its revenue.
These 90% will be a flash in the pan, same way the COVID revenue was for mask sellers. Sure it feels bad from Nvidia's perspective, but we also can understand that the AI boom would not have kept Nvidia skyrocketing infinitely anyway.
It's a huge shift, but not something that can be acted by Nvidia, nor something they had to care about 5 years ago, nor a primary concern 5 years from now. On the long scale, it's almost as if the big fireworks that pushed Nvidia to its curent valuation just disappears and they're back to selling GPUs to OEMs and consumers primarily.
It's kind of like how people may make fun of YouTube seeing TikTok as a competitor. But you dig deeper and realize why they decided to get into short for content.
Nope; if hypothetically 100% left NVidia, whether to their own hardware or to not use GPUs at all, it'd be easy to say NVidia would be last in the market
Gaming is not entirely Nvidia's turf either. AMD has 75% of the console market (Xbox and Playstation) and 30% of the PC market.
Looking at these numbers[0] for the console market:
> Sony has sold 61.94M units of PS5 and Microsoft has sold 30.14M units of Xbox Series X|S and Nintendo Switch sold 143.49M units.
Nintendo (NVidia chip) sold 1.5x of Sony and Microsoft combined. Given Switch's success the numbers look reliable to me, then Switch 2 is of course also from Nvidia, and I wouldn't be against it selling well.
[0] https://hookedontech.com/switch-vs-ps5-vs-series-x-console-g...
https://www.ign.com/articles/ps5-has-best-holiday-ever-overa...
In terms of revenue, AMD has the vast majority of the console market.
Yes the Switch sold more units, but that is a smaller SOC with much lower revenue.
Revenue and profit is what matters, not the number of units sold.
Check the price of the PS5 Pro vs Switch.
AMD has dominated the console market since Xbox One / PS4.
Nvidia could be earning $30 - $50 per Switch, while AMD earns $120 - $200 per PS5/PS5 Pro.
Just the hypothetical "if X% of your customers leave, but don't go to competitors, won't you keep your relative market position"
NVIDIA is very strategic about building product to avoid commodification -- both by building out network effects where software is tied to their proprietary sdk libraries, and by always focusing on being at the cutting edge of product.
Both these things can be true: a large company should try to build their own hardware to reduce supplier risk, and a large company should be open to suppliers that have better product that delivers business value.
So far, these large companies' internal hardware has been useful internally but never a complete replacement for NVIDIA, which keeps staying at the cutting edge of new capabilities.
NVIDIA already faced existential risk when Intel was commodifying all the dedicated motherboard components in the late 90s, 2000s, (like sound cards etc), so they're hyper-aware of this.
don't know much about the rest tho
Google use their own hardware for AI/HPC. Nvidia hardware is offered to external customers who demand it on Google Cloud Platform.
The AI datacenter explosion has only occurred within the past two years. We are talking about plans that will take years to implement. The hyperscalers are trying to cut out Nvidia as soon as possible.
The company that can allow collaboration up the value chain only like Google can in this space right now is going to win. The author went over similar pushes by Meta, AWS, and Microsoft.
Now that their eyes are on the prize, and the prize is so staggeringly big, I'm convinced of the threat to their moat.
Fair Disclosure: I am very neutral when it comes to FLOPS/W/$ and the generality of those FLOPS. Given inference and training, the advantage is slipping.