> Their robots.txt is password protected now. (?)

It lets you in regardless of the username/password combination. I just logged in with this:

username: you morons

password: this defeats the whole damn purpose

I wonder if any of this gets logged at their end.