ParentFull threadwatchdogtimer·You could do this using a robots.txt file (assuming the scraper obeys it, of course).View on HN