Hacker News Reader

Comment by ilaksh | Hacker News Reader

I would really like a "reasonable" monthly price for a VPS with a GPU. Even a consumer card like a 3090.

vasti.ai have the best prices I have seen, but comes with limitations, and still not the best deal for an entire month.

Given the cost of the hardware and power and everything else required to run it and support it, how can you say that 20 cents an hour is unreasonable? There's very little profit margin there. At this price it would take roughly a year for them to make a profit. If you need continuous usage at the lowest price then you need to buy a GPU on ebay.

Nvidia has a datacenter tax in their driver terms of use, so you won't find consumer card vpses at consumer like prices.

Most offers are fine, the A100 I rented was a scam, however. A scam in terms of: advertised as A100, performing like a 1080. I guess the seller partitioned the card or rigged the id. You can report frauds like this on their page but only while you are renting.

I would hope vast.ai would be able to detect MIG at least.

It could also be a low power cap - I had a Dell C4140 for a bit with 220V power supplies and 120V power, locking the entire thing to ~50% of the max power cap per GPU basically.

That is fine when you are using your own machine and fraud when you rent it to others.

Checked out vast.ai but you can get down to the ~$0.34/hr at Runpod depending on how much vram you need.

Reply on news.ycombinator.com