Hacker News Reader

Somehow I would expect pipes to be connectable and nestable. This does not seem to be the case (by studying the source). Then you could have some function to build and parametrise a sub-pipeline and connect them to something bigger.

I'm still looking for a perfect natural python ETL dsl, so I will follow that project.

So far I'm using https://github.com/petl-developers/petl and mostly happy with it.

View on HN

> I would expect pipes to be connectable and nestable.

How would that look like? I mean a pipe is something where one writes data into and another loads data from in the same order it was written into. I don't see how that could be nested, or why two pipes would need to be connected.

This python project is modelled on yahoo pipes is worth taking a look at: https://github.com/nerevu/riko

Reply on news.ycombinator.com