Hacker News Reader

Comment by raphaelj | Hacker News Reader

Still pretty expensive IMO.

I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performances are a little bit low, but mostly enough to make the app usable.

I tried to find GPU instances for < $50/month, but couldn't find any. The only alternative would have been to rent Apple M1 instances at Scaleway, but it's still way more expensive (€80/month) than hosting my 10 watts Jetson at home.

Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops

View on HN

Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr.

https://lambdalabs.com/service/gpu-cloud

Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.

How dare someone self-promote in the midst of your self-promotion?

I am answering to the version before you edited it.

You are absolutely right, and I apologize if I came across as dismissive. We may have different viewpoints, and it's important to respect and acknowledge each other's perspectives. I appreciate your input, and I'm here to listen and address any further questions or concerns.

Let's keep the conversation friendly and open.

what do you mean with "the estimated cost of approximately $800 per month"?

Parent is saying $1.10/hr = $792/mo of GPU leasing. GGP is looking for $50/mo. Obviously $792 is a lot higher than the GGP's request for $50/mo.

Whether or not $50/mo is an unreasonable ask (it is), they have a budget and feel that even $85/mo is too far out of budget for their application.

> what do you mean with "the estimated cost of approximately $800 per month"?

Presumably they mean

$1.1/hr * 24hr/day * 30day/month = $792/month

> We also just launched H100s for $2.40/hr.

What's the availability like? I had tried it once and had problem getting any GPU.

We have lots of H100s available right now.

Thanks! Is there a status page like https://oblivus.com/availability/ for Lambda Cloud? I got very excited about building a product on top of Lambda cloud for cocalc.com, but after read lots of docs, when I tried Lambda cloud, I just got the message: "We are currently out of capacity for all instances. Please check again in a few hours." This was on April 27. I immediately thought: "There is no possible way I can build a product on this for my users, but it may be very useful for other tasks, e.g., training." If there were something like https://oblivus.com/availability/, especially with historical data, it would be very useful to appropriately set my expectations about how Lambda Cloud can best be used.

By the way, Lambda Stack is VERY impressive. Thanks for maintaining that!

Lambda availability is awful.

On vast.ai I rent 3090s for $0.12 an hour. Nothing comes close in price.

They operate a model known as a "marketplace" or "community" cloud. Unlike us, they utilize servers hosted by individuals in their homes. This is something completely different.

While they may offer lower prices, the infrastructure may have limitations in terms of reliability, scalability, and security compared to data center-based providers. Additionally, the performance and availability of the services vary depending on the hosts' hardware and internet connection.

No, it's not just individuals, and not just at home.

Biggest problem with vast.ai is data security. It is running on somebody's PC. Anybody can get hold of your data.

Thank you for your feedback!

If you're working with Jetson, the RTX 4000 may be more powerful than you need right now, and it's the least expensive we've got. It's worth exploring if there are cloud service providers that offer lower-end GPUs, as that could potentially be a better fit for your requirements and budget.

Less than 50$ will be really hard, at least in any form of professional setup (so not hosted in a random basement ;) ).

Our lowest at Genesis Cloud at this time are instances with an RTX 3060Ti for 0.20$/hour which adds up to 146$/month ( https://www.genesiscloud.com/pricing#nvidia3060ti ) Though, this includes free storage, no egress fees and has a lot more power than a Jetson.

If you need to optimize for low cost hosting, did you already check whether you actually must have a GPU for your use case? Modern CPU have some impressing capabilities.

Here we have another instance of self-promotion that does not align with what GGP mentioned. Thank you, Genesis and Lambda, for promoting yourselves in a startup thread. Given your long-standing presence in this industry, I would expect better engagement from you.

You were doing so well, self promoting and engaging with the community on your post earlier. I didn't expect to see you stoop to this level of commenting.

Maybe it's time to step away from the keyboard for a while?

I appreciate and respect every user who contributes by asking questions, providing feedback, or sharing suggestions. However, it is disappointing and unreasonable to witness self-promotion from companies that have been established in this industry for a considerable period of time under a startup thread.

Moreover, the fact that their self-promotion does not align with the intention of the original discussion and GGP explains their purpose. Their primary goal is not genuinely assisting or finding a solution.

In such cases, as you can imagine, it's challenging for me to maintain respect.

If you're finding it too challenging, might I reiterate my suggestion to take a break from the keyboard? it's not a good look.

You make a valid point, and I appreciate your suggestion.

I apologize if my previous comment came across as dismissive. I believe I have expressed my viewpoint clearly, but I'm open to further discussion.

Let's continue this conversation in a friendly and respectful manner, but after I come back from my break as you have suggested. :)

Reply on news.ycombinator.com