But Amazon had K80s and a few other low end GPUs that serve this purpose. What is different about what you propose? The only thing I can think of is I might like a GPU with a lot of memory but low throughput, so I could check batch size related stuff more easily.
I have discovered that unless you are boiling-the-ocean either mapping genomes, folding protein structures, or training CV models, you probably can get by with older technology provided you can run on an actual piece of hardware and not a virtualized instance (again could be out of my depth here).
I have successfully launched two very stable, powerful enough for my purposes, GPU-enabled instances. I thought that if other people had a similar need for low-priced but powerful computers for a short period of time, there might be some community / club that could be built around this need.