Nvidia GPUs are also used for inference on Google products. It just depends on availability.
Interesting, do you have a source for this? I've not been able to find one.
GCP plans offer access to high-end NVIDIA GPUs, as well as TPUs. I thought Google products use the same pool of resources that is also resold to customers?
Only some Google products. Most still run on internal platforms, not GCP.
OK, interesting, so there is some dogfooding, but it's not complete.
Not true. Apple trained some models on their TPU
Apologies, to be clear what I meant was that to my knowledge Google doesn't use GPUs for it's own stuff, but does sell both TPUs and GPUs to others on Cloud.
Also, to be clear, I have no internal info about this, I'm going based on external stuff I've seen.