This post may be tongue in cheek, but realistically that's right. I ran the Facebook chatbot that was posted maybe a month ago and didn't get good performance until I was using many Tesla v100 GPUs, which are $8k each. Thankfully modern CSPs like Azure allow renting rigs that can handle this pretty easily.
How much does that cost?
The largest AWS instances are $30-something/hr on demand, less with reserved time. So pretty expensive.
21.3 USD/h in vast.ai (8X Tesla V100, 118.8 TFLOPS)
More or less the cost of a well trained, experienced customer service representative?
Yeah but the cost will come down.
that's only 256GB, which isn't enough. I'm not sure it's even possible to nvlink 16 v100s. I'd love to try it out for $40/hr if it were possible though.