Thanks, I created this tool to exactly find cheapest GPUs then expanded to everything else.
Interruptible is sufficient for model training which is what these high end GPUs are typically used for (and you want cheapest possible)
Interruptible is sufficient for model training which is what these high end GPUs are typically used for (and you want cheapest possible)
I was wondering, do you happen to have an API for listing servers? We're launching a marketplace later in August (https://www.tensordock.com/product-marketplace), and we expect pricing to be really really cheap. Like #1 in industry cheap while retaining.
Interruptible, if we add that, would probably be even less than those prices listed.
It'd be really cool if we could auto-update availabilities of GPU servers through an API so that we can list our servers on your tool as well :)
Some unsolicited feedback, if you're still actively developing:
- You should consider some of the lesser known cloud providers (e.g. Coreweave/Lambda Labs/TensorDock).
- Add information about whether the servers support NVLink/NVswitch. For example, A100s come in 3 flavors: PCIe without NVLink bridges, PCIe with NVLink bridges, and SXM with NVlink/NVSwitch fabric.