Hacker News Reader

Comment by arthurcolle | Hacker News Reader

I've been using Airflow for the past 6 months extensively in my projects and it is such a pleasure to use. I am excited to try out this release. Had a little trouble integrating Selenium and webDriver using BashOperators that run individual Python scripts and should probably switch to PythonOperators soon.

View on HN

If you're switching to python operators you should check out the TaskFlow API. You can basically build python operators with just python functions and decorators.

Can you still chain dependent tasks together with the cute ">>" syntax? I like that, makes reasoning about task orderings and co-dependent tasks pretty easy to write and think about.

Unfortunately that is one feature that we had to take out, but you should check out the TaskFlow API, it's a very worthwhile trade-off!

Edit:

Sorry I misspoke here

The only thing that is no longer allowed is using a bitshift operator between a DAG and a task.

  task_1 >> task_2

is totally fine

  my_dag >> task_1

Is no longer allowed. Apologies for the miscommunication.

So if I am on 1.10.6, and upgrade, all of my existing scripts will break as >> is removed?

WAIT. Sorry I misspoke.

The only thing that is no longer allowed is using a bitshift operator between a DAG and a task.

  task_1 >> task_2

is totally fine

  my_dag >> task_1

Is no longer allowed. Most of your DAG should be completely fine. Apologies for the miscommunication.

Thanks, you almost gave me a heart attack ;)

Thank you for clarifying, that scared the heck out of me.

Is there an official guide of how to update from 1.10.x to 2.0, or do we still need to do the 1.14 update, then move over? I'm interested in updating ASAP, but scared to break my production.

I posted about that here. They recommend the .14 release.

https://stackoverflow.com/q/65345789/220997

Reply on news.ycombinator.com