Hacker News Reader

Your question isn't the question you should be asking.

Please answer the question:

How is reddit supposed to prevent scraping when it is legal to do so, and they have incentive to appear in search engines? Considering that scraping is legal and WILL happen, why not opt to reduce the load by offering an API?

View on HN

If consuming their content by scraping was easy, nobody would be complaining about the APIs being taken away... it's very easy to make web scraping impractical if they want. Don't be deluded.

The context of the thread is machine learning companies. You're delusional if you think they don't have a ton of web scrapers running 24/7 already.

Reply on news.ycombinator.com