Hacker News Reader

The best way to scrape already for many years is using a headless browser plugin. For example phantomjs with nodejs. That in combination with tor or a large proxy pool is unbeatable by all other alternatives.

View on HN

This is how it works under the hood. But everything is wired for you ;)

I wouldn't scrape over Tor, you would be slowing down the network for people who actually need it. Maybe if you are running a node.

Reply on news.ycombinator.com