Ask HN: Adaptive Spider Technologies?

1 pointthrowavay4522 comments

Today a bot from 174.127.132.210 tried to copy information from my stealth-mode site (not linked to any domain name). This site was not supposed to be searchable and is known to a very limited number of people.

Any experience with such bots?

View on HN

I've been blocking 174.127.132.0/22 for a while now.

It's generally not worth getting into an arms race against misbehaved bots, unless you're prepared to setup a honeypot or seriously analyze your access logs.

Thanks! Good to know it's common

Reply on news.ycombinator.com