Our customers do things like the following:
1. Monitor online ad distribution
2. Build directories of people on the web
3. Check for IP violoations (digital watermarking, etc.)
4. Build niche, localized search engines (picture searching, regional searching, etc.)
5. Collect information on product pricing, retail data, etc.
Crawling gets a bad rap. It's useful for a bunch of stuff.