Suggest you check out https://composable.ai for building out robust data pipelines