The main use case is on demand neural net inference 24/7 availability.
Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7.
It runs on the order of 50x faster on an nvidia GPU compared to a CPU.
But it will sit idle most of the time.
Price per hour per GB of GPU ram is the most important metric when choosing a server.