> Google ignores websites privacy. Even if the website owner doesn't want to expose any content for search engines, Google will come, get it, and show it on its search results and will make money off it. Absolute, unadulterated nonsense. The Google spider identifies itself via HTTP headers. It's trivial to refuse service to specific clients.

Google spider ignores rules in robots.txt and show results from closed directories. I could write a distinct article about how we fight against it.