+1 to this, we kick off our Sqoop jobs using Airflow - http://airbnb.io/projects/airflow/
Airflow is very similar to Luigi; we've been using in in production to schedule all of our workflows for ~4 months now and it's worked out really well for us.
Airflow is very similar to Luigi; we've been using in in production to schedule all of our workflows for ~4 months now and it's worked out really well for us.
No comments yet.