HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by werid | Hacker News Reader
Parent
Full thread
werid
·
Now it's indexed by search engines?
View on HN
icebraining
·
https://www.google.com/search?q=inurl%3Arobots.txt
Not that I agree it should be further divulged, mind you.
Reply on news.ycombinator.com