Good article on those wondering about Spark vs. Hadoop. Bottom line: Spark may not be as mature as Hadoop yet, it is probably the way to go. One big advantage is that Spark runs in-memory and the performance can be up to 100x of Hadoop.