Hacker News Reader

Comment by pyuser583 | Hacker News Reader

Your comment made me smile because Apache Beam is one of my favorite tools, but it seems nobody outside Spotify has had heard of it.

The bitwise operation dunder methods have no definition outside of integers. So they’re basically freebies to do what you want with.

Honestly I think the Apache Beam API makes a lot of sense.

View on HN

To be clear, I love Beam. It runs all of my startups stream and batch processing.

I just think the Java API's version...

    pipeline = pipeline
      .apply("FirstTransform, MyFirstParDo())
      .apply("SecondTransform, MySecondParDo())

is much clearer than the Python version...

    pipeline = (
        pipeline
        | "FirstTransform" >> MyFirstParDo()
        | "SecondTransform" >> MySecondParDo()
    )

Agreed. I prefer the Java version, for a number of reasons. Scio is even better. But the bitwise operations make sense python wise.

This is because it started out as a Google project. There is an internal time-series framework there called Monarch that does the same thing for composing operations.

I have to agree with this sentiment.

Reply on news.ycombinator.com