I'm not sure about others, but you can get A100s with 90gb of RAM from DigitalOcean for $1.15 an hour. So about 1/3 the price.

You can even get H100s for cheaper than these prices at $2.24 an hour.

So these do seem a bit expensive, but this might be because there is high demand for them from customers and they don't have the supply.