We used the site to seed our crawlers. It's been great.