Hacker News Reader

You can use wayback_machine_downloader to automate downloading the archived pages https://github.com/hartator/wayback-machine-downloader/

View on HN

That used to work great for me, but recently it started to fail. It downloads a few pages but then it gets errors, as if it is detected and prevented by the server from scraping.

> as if it is detected and prevented by the server from scraping.

Yes.

There is a fix for that. This might point the way: https://github.com/hartator/wayback-machine-downloader/issue...

Reply on news.ycombinator.com