The largest AWS instances are $30-something/hr on demand, less with reserved time. So pretty expensive.
21.3 USD/h in vast.ai (8X Tesla V100, 118.8 TFLOPS)
More or less the cost of a well trained, experienced customer service representative?
Yeah but the cost will come down.
that's only 256GB, which isn't enough. I'm not sure it's even possible to nvlink 16 v100s. I'd love to try it out for $40/hr if it were possible though.