You don’t even need ai to detect a bot user agent on your site, its easy enough to fingerprint them if you cared to do so. The fact that most webmasters don’t care to do so is also why its so easy to fingerprint them.