ParentFull threadnicbou·Every website is different, but if a single bot is bringing your website to a crawl, you should probably start caching a few things and working on performance.View on HN