Its actually a rather interesting / cunning behavior in contrast to the given ecosystem. Abstractly, this coupled with a suitable robots.txt could unravel the Google economy. Perhaps even establish a linear relationship between " yahoo, everything is free " people.