There's a company in my e.f. cohort who do most of their work on a box with 48GB of video memory. Another regularly spins up clusters to do machine learning on large video datasets to identify theft.
Most accelerators have partners that can get this stuff for cheap or free - including physical boxes.