You’re moving the goalposts. We aren’t talking about who has a right to what. We’re talking about what is and what isn’t a deranged dick move.
Google, Amazon, you name it do this infinite times a day with crawlers.
If you build a business on taking resources from some public source, on a large scale, you could very well be out of a business at any time. This has been the case for a long, long time. And nobody seems to take issue with it.