I'd be interested in how large the range is here across company and region and specific data center and how it relates to companies like Hetzner if at all.
I'd be interested in how large the range is here across company and region and specific data center and how it relates to companies like Hetzner if at all.
[0] https://www.selc.org/news/xai-built-an-illegal-power-plant-t...
Well considering that ~80% of the price is hardware deprecation, I don't know why they'd be considerably worse than anyone else at negotiating hardware deals.
Typically when you buy in bulk, you have more sway.
Companies like Google also have in-house chips like TPUs that are substantially cheaper for inference for them to make than anyone else can get through Nvidia.
Google and MS may be close behind.
Not sure about Meta but they are also renting from Amazon so...
Anthropic mostly rents from Amazon, Goog & MS.