Foundation models are starting to outstrip any consumer hardware we have.
If Nvidia wants to stay ahead of Google's data center TPUs for running all of these advanced workloads, they should make edge GPU compute a priority.
There's a future where everything is a thin client to Google's data centers. Nvidia should do everything in its power to prevent that from happening.
Last time I checked, they couldn't produce enough H100s/GB100s to satisfy demand from everyone and their mother running a data center. And their most recent consumer hardware offerings have been repeatedly called a "paper launch" - probably because consumer hardware isn't a priority, given the price (and profit) delta.
Nobody is running H100s at home, nor are most video companies running ones. So the choice for them is to "rent" them from Google, or... invest a lot in almost impossible to obtain Nvidia hardware? One has lower initial cost, and is available now.
But as long as Google isn't their _only_ customer, why would Nvidia care?
there has always been, the mainframe concept is not new. but it goes in and out of fashion.
>>>> mainframe
<<<< personalpc
>>>> web pages/social media
<<<< personal phones/edge
>>>> cloud ai
<<<< ???? personal robotics, chips and ai ???
>>>> ???? rented swarms ???