Hacker News Reader

Comment by dimberman | Hacker News Reader

If you're switching to python operators you should check out the TaskFlow API. You can basically build python operators with just python functions and decorators.

View on HN

Can you still chain dependent tasks together with the cute ">>" syntax? I like that, makes reasoning about task orderings and co-dependent tasks pretty easy to write and think about.

Unfortunately that is one feature that we had to take out, but you should check out the TaskFlow API, it's a very worthwhile trade-off!

Edit:

Sorry I misspoke here

The only thing that is no longer allowed is using a bitshift operator between a DAG and a task.

  task_1 >> task_2

is totally fine

  my_dag >> task_1

Is no longer allowed. Apologies for the miscommunication.

So if I am on 1.10.6, and upgrade, all of my existing scripts will break as >> is removed?

WAIT. Sorry I misspoke.

The only thing that is no longer allowed is using a bitshift operator between a DAG and a task.

  task_1 >> task_2

is totally fine

  my_dag >> task_1

Is no longer allowed. Most of your DAG should be completely fine. Apologies for the miscommunication.

Thanks, you almost gave me a heart attack ;)

Thank you for clarifying, that scared the heck out of me.

Is there an official guide of how to update from 1.10.x to 2.0, or do we still need to do the 1.14 update, then move over? I'm interested in updating ASAP, but scared to break my production.

I posted about that here. They recommend the .14 release.

https://stackoverflow.com/q/65345789/220997

Reply on news.ycombinator.com