ParentFull threadidoco·That is a very good point. Security crawlers should probably use a masked user-agent.View on HN