I'm familiar with web scraping...hasn't it always been looked down upon though? It just seems like it's got a negative connotation or something.
Why scraping is any worse than crawling is beyond me. But again, it depends on the application. I built a concert search engine which scraped data from multiple sites. It is my understanding that all the concert sites are getting a bunch of data from published apis and then topping up with scraped data.