Gpulist – Craigslist for GPUs | Hacker News Reader

Gpulist – Craigslist for GPUs

gpulist.ai

91 pointsetaioinshrdlu38 comments

Hmm who's this for? vast.ai seems far more reputable and competitive: https://cloud.vast.ai/create/ Why would I bother getting in touch with a random seller when there's a whole eco-system already in existence?

I'm trying to figure this out too. The great thing about CraigsList is that sellers are physically local, and you can haggle with them. From a seller's perspective, a physically localized audience means less competition. None of that applies here.

Aesthetics? I guess?

Does vast do clusters? This is for clusters.

Wow, H100 for $2.80/hr, A100 for $1.80/hr. How reasonable are those prices? Seems pretty reasonable.

I expected this to be actual GPUs for sale

Yeah, Craigslist for GPUs is a terrible tagline.

My first thought was, isn't Craigslist Craigslist for GPUs?

craigslist for gpu cluster rentals?

It's not? Craigslist is for buying other people's old used stuff. I assume that means this site is for buying old used GPUS, maybe sourced from reputable sources.

These are rentals. With the exception of housing, craigslist is mostly used for sales.

Relevant context: this is being headed by Daniel Gross and Nat Friedman.

https://twitter.com/natfriedman/status/1757923480434323521

Who the hell are they?

Am I misunderstanding something, or are these prices insane?

Well the cost of the gpus themselves is insane. A single h100 you can hold on your hand costs the around the same as an entire Tesla model 3.

Less chance of fatal-to-operator malfunctioning tho.

$30K<->$40K and it apparently costs Nvidia around $3.3K to manufacture an H100 GPU for info

Cost to produce doesn't matter. The reason these things are so expensive is demand and the limited capacity of fabs to produce them.

You pay mostly for CUDA, not the GPU

Anyone have any predictions about when the prices will start going down significantly? Anyone think we could see price per hour per GPU cut in half by July?

When some more EUV fabs come online. So... 5-10 years min.

Looks like we have a bunch of start-up cloud companies who have money being thrown at them by god knows who buying thousands of H100s and other GPUs. These are all going to come online around the same time in early spring. I think we will see prices drop rapidly by June .

They're not only insane (i.e. offering H100s for rent at a quarter the price they'd be to purchase) they're also impossible, since every listing claims to have deployed an Infiniband fabric speed which is firmly in the future.

Jonathan from TensorDock (https://tensordock.com/) here - we listed two of our A100 and H100 clusters on the site.

The IB equipped on our clusters (can't speak to others) is 8x 400 Gbps. Most customers training foundational models are able to fully utilize that fabric in parallel.

Which HCAs are enabling that? You're using eight 4-link QSFPs here?, presuming this is NDR?

And out of curiosity, is aggregate bandwidth the normal marketing metric in this industry? In my neck of the woods this would be reported as an NDR400 system.

Isn't 2-3$ per hour the standard rate for A100s and H100s spot pricing?

Yeah, looks like you’re expected to spend a minimum of $3,000,000 to meet the minimum requirement for some of the offerings.

I can almost visualize future commodity/options/derivatives trading market around underlying GPU per hour rental prices...

You know, a contract to rent a cetain GPU at a certain price per hour for a certain number of hours -- would be sort of like a commodity delivery contract.

Once those are created, then options, but more broadly, financial derivatives -- could be created on top of those...

Once those are created -- they could then be traded, held long, sold short, and otherwise "invested in" and/or "speculated on" -- depending on what terminology one prefers...

Also, to be clear, I'm not saying that this should be done -- only that it could be done...

That is (and pardon this exceptionally bad pun!) -- with respect to trading possibilities around the GPU rental prices market, you could say I am only speculating! :-) <g> :-)

Anyway, thumbs up for GPUlist!

Can you add the cost of the minimum reservation inline too? E.g. if it were $1/gpu/hr and "Minimum 1 GPU for 1 week" then make that text "Minimum 1 GPU for 1 week ($168)". This would allow faster comparison between options when on a budget.

This would particularly help with the second entry that's $2.30/HR but a minimum cost of over ten million dollars.

That's more to rent them for 2 years than it would be to buy the gpus outright, it seems. I guess adding on the cost of all the supporting hardware might exceed it though.

If it doesn't have creepy guys making missed connection posts about women they saw and were too afraid to talk to, it's not Craigslist.

Should take it to the next level and make it automatic- AirBnB for gpus

craigpu would have also been acceptable

GPUber?

Truth is indeed stranger than fiction - none of my cyberpunk bingo cards had this on it.

This is like vast.ai right? Or is it even the same place?

Limited to only 3 types of GPUs?

Is TensorDock a vast.ai wrapper?

Hi! Jonathan from TensorDock here :)

We have our own supply base (sourced through https://tensordock.com/host), operate some of our own servers, and are not related to any other marketplace :)

We think we have better security & reliability than Vast.ai due to virtualization rather than Dockerization, as well as more strict access controls [1]. Additionally, you can run Windows VMs on us if you want :)

[1]https://tensordock.com/security

Reply on news.ycombinator.com