__vb__

A genuine question: How does Facebook already not address those points? Its an open platform and actually faces a lot of bar rep for being too open?

By open I meant: people can say/post whatever they want.

databricks has other optimizations on top of open source spark version, are you maintaining your own version of spark or using the vanilla version of spark.

One thing I constantly deal with is how to optimize spark, how to use ganglia and spark ui to dig into what is causing data skew and slowness while running jobs. Is this something that you do better than databricks?