Hacker News Reader

Lambda labs will rent you an 8xA100 instance for 3 months for $21,900. That would put it at around $2m

Still a bit to expensive for my sideproject ; ) To be honest it seems only big corp can do that kind of stuff. By the way if try to do hyper parameter tuning or some exploration in the architecture it becomes guess 10x or 100x more expensive.

AWS has them in US-EAST1 for $9.83/hr spot with 96 CPU cores, 1152GB of ram, 8 A100s with 320 GB of RAM, 8TB of NVME, and 19 Gbps of EBS bandwidth to load your data quickly.

https://aws.amazon.com/ec2/instance-types/p4/

p4d.24xlarge

An alternative is the p3.16xlarge for 8 V100s with 256GB of GPU RAM but you might as well get the A100s since it's only $0.50/hr cheaper

https://coreweave.com/ offers some of the cheapest GPU compute out there

16,000,000 at MSRP