I tried to run airflow; I found pretty much everything about it to be wrong for my usecase. Why can't I easily upload a workflow through the UI? Why doesn't it handle S3 file staging for me?
It definitely takes some time getting used to the quirks of Airflow. I know it took 6 months of running it at my last gig to really understand what was happening underneath the UI.
With great control comes great responsibility.
actually I concluded it was just not that great a workflow engine. It's probably just intended for a different use case than mine.
Would love to hear more about your use case and your issues -- you can sign up on our website (magniv) or send me an email jon at our domain.