Most crawlers/bots, particularly the ones you want to be able to identify, spoof their user agent, making this mostly moot.