Hacker News Reader

Make crawlers not scrapers.

Depends on your use case. If you just need specific data from a known location, build a scraper.

If you’re looking to index as much data as possible, build a crawler.

The complexity of a crawler is significantly more than a scraper, so it’s not always the right choice.

Make open APIs, not scrapers.

The problem is that most companies/developers still aren't "Open API first"... So, people must build scrapers.