But don't you think the bot has already stopped crawling the site due to it being unavailable? That's probably gonna hurt too.