Hacker News Reader

The zip files can be up to 50GB as well, but they recently changed something on the backend so that if you do use the zip option you may still get however many 50GB files then maybe a 1MB, a 7kB, and a 1GB file, I assume because of the way they parallelize the tasks. I don't know if the tar option behaves in the same way.

View on HN

Oh, interesting - I wonder if that's new. The last time I checked (granted, a few years ago), it was limited to something much smaller.

I have noticed that the tar files toward the end tend to be smaller, but they still typically weigh in at multiple gigs apiece - 37, 14, etc.

Reply on news.ycombinator.com