What exactly was the mention of Kafka referring to? Spark has had decent kafka integration for a while now.
Matei was actually talking about the existing Spark Kafka direct stream implementation, which has been available since Spark 1.3
The video of the talk is available here: http://livestream.com/fourstream/sparksummiteast2016-tracka/...