They fake user agent, they throttle or go slow and even try to emulate mouse movements. I am not kidding that they had the audacity of doing 270k pages in a single day and they returned multiple days.