Hacker News Reader

Actually, plenty of guys use Hadoop for CPU bound problems.

And the fastest way to use it this way is Java, which is what the number crunching users of Hadoop use. Which is to say that the emerging big data compute platform is Java. Which is to say that you're wrong.

View on HN

Hadoop is not "for CPU bound problems." It's for huge data. There are much better frameworks for the problem of splitting a parallelizable computation across machines. Nobody would use Hadoop just for that.

Why would Java be the fastest way to do computations with Hadoop? You can use many languages for the map/reduce pieces. The fastest language would be fastest language, not necessarily Java.

Of course I'm talking about those subset of problems which are CPU bound and also use huge data.

As to why streaming is slow: I don't know. It just is. Check it out. C++ streaming performance is the pits.

Reply on news.ycombinator.com