Hacker News Reader

Comment by m_ke | Hacker News Reader

Cloudflare could really shake things up on the ML side of things. The egress costs and GPU prices on AWS and GPC make them a nonstarter for most companies, forcing people to rack their own hardware.

View on HN

Most companies except the ones paying AWS/Azure/GCP a combined $100B+ per year and growing fast?

Yes except for the ones that are lighting saudi money on fire by having softbank pay for it.

A lot of ML startups end up buying hardware for training because they can get a GPU for what it would cost them to rent it for 2 months on GCP/AWS.

That sounds right about ML startups. But ML startups or even venture funded companies are a very small percentage of companies - especially when it comes to spending signficant dollars.

My original comment was referring to companies who train their own machine learning models. They might not be spending the way large slow corporations and the government do but there's a lot of investment in the space and a ton of room for growth.

The company I work for is one example (of MANY) that is finding it quite cost effective to host on AWS as compared to maintaining our own data center.

That being said, I certainly wouldn't mind seeing AWS and Cloudflare get into a price war that lowered egress prices.

Yes we use GCP for production workloads and enjoy the benefits of being to scale at will. I'm strictly speaking about hosting large multi TB datasets and running machine learning training jobs that end up costing thousands of dollars each.

Reply on news.ycombinator.com