HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by chadwebscraper | Hacker News Reader
Parent
Full thread
chadwebscraper
·
Shoot me your site and I can blacklist it
View on HN
xnx
·
That's what robots.txt is for.
Reply on news.ycombinator.com