Hacker News Reader

The cost of GPUs doesn't make sense for the compute they offer.

According the benchmark, the fastest 8 GPU node takes about 0.5 seconds. The cost of that node on AWS is about 24$/hour. The 21 node spark cluster takes 6 seconds. But, it only costs 4$/hour.

An additional benefit with Spark is that it can be used for a lot more variety of operations than a GPU.

This cost disadvantage restricts GPU processing to niche use cases.

View on HN

> According the benchmark, the fastest 8 GPU node takes about 0.5 seconds. The cost of that node on AWS is about 24$/hour. The 21 node spark cluster takes 6 seconds. But, it only costs 4$/hour.

Using your numbers, the GPU solution has half the cost for similar performance? How does that not make sense?

> This cost disadvantage restricts GPU processing to niche use cases.

All GPU compute applications are niche use cases.

Look man, you don't get it. The GPU case is half the cost, but it's also twelve times faster.

Oh, wait...

> The cost of GPUs doesn't make sense for the compute they offer.

This assumes AWS pricing. You build a farm of GPUs and buy in bulk, you get much better cost basis. GPU farms are becoming more and more of a thing now and definitely less 'niche'.

Reply on news.ycombinator.com