https://twitter.com/emostaque/status/1563870674111832066 says
"We actually used 256 A100s for this per the model card, 150k hours in total so at market price $600k"
I think you have to compare it to how much ETH you could have mined as the opportunity cost of training a model vs other uses of a GPU