HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by colonelspace | Hacker News Reader
Parent
Full thread
colonelspace
·
At bottom, all robot actions are human initiated.
View on HN
s3p
·
Exactly, so they should ignore robots.txt !
Reply on news.ycombinator.com