I genuinely wonder this. Can I say, "it's OK for XYZ to scrape, but not ABC?" (Or is it general use -- scraping OK/not OK?)
I think it's different for API usage, because you enter an agreement with an entity by signing up, etc. I'm speaking specifically to the unauthenticated scraping/indexing.