Google also does not depend on NVIDIA, thx to TPUs. Rents NVIDIA GPUs to external customers - sure, it's a nice side business, but internally TPUs are king and there's no dependency on NVIDIA for that.
Google also does not depend on NVIDIA, thx to TPUs. Rents NVIDIA GPUs to external customers - sure, it's a nice side business, but internally TPUs are king and there's no dependency on NVIDIA for that.
Deepmind says otherwise. training is most likley all on NVIDIA still. Same for Apple.
The difference is, nobody knows for sure with Apple, because they are a secrecy cult.
On my side, I would like to point that the today HN thread ([1]) that discusses a paper GameNGen ([2]) that runs Doom with diffusion models was trained on TPUs.
I don't see a dependency on NVIDIA there.
If there's a more specific rebuttal to my original statement, please, don't hesitate to state it.
1. https://news.ycombinator.com/item?id=41375548