Monitor access logs for links that only crawlers can find.

Edit: oh, I got your point now.