You could also consider Kafka for streaming, and Parquet for batch.