Hacker News Reader

I'm similarly confused. It seems to be a family of table encodings that sacrifice encoding simplicity for compactness. PyArrow implements parquet files for example, but also I think feather? PR for this project is a mess. Front page should be a bullet point list of deliverables rather than aspirations nobody understands

View on HN

Come on, it's on the top of the front page https://arrow.apache.org/

You don't understand, I'm already a user of PyArrow and it doesn't match that page at all. It handles Parquet and Feather, right? They don't appear on the home page. Clicking the "specifications" link instead starts to talk about Flatbuffers. What's going on?

Arrow is the in-memory format, PyArrow supports loading and saving that data as Parquet and Feather formatted files.

Parquet and Feather are on-disk file formats. Arrow is an in-memory format.

Parquet is not Arrow, but they work well together, in that one can easily be (de)serialized to the other.

Feather uses the Arrow IPC format internally.

Their FAQ page at least answered some of that for me. Have the same feeling.

http://arrow.apache.org/faq

Reply on news.ycombinator.com