HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by rolph | Hacker News Reader
Full thread
rolph
·
on spider request
send robots ToS clickthrough
on fail redirect.
View on HN
cdme
·
I just 403 them as best I can.
Reply on news.ycombinator.com