Right or wrong, that is how things stand today. Companies (websites) go to extraordinary lengths to please Google (SEO etc) and want Google to crawl/index their sites. But they will unleash their lawyers on some kid that scrapes data and builds something useful (remember how Craigslist went after someone who built a better/simpler interface few years ago?)
Plus users agreed to tech giants' terms of service (it is a different story that almost no-one reads them and have any understanding of them in the real sense) whereas users did not agree to OP using some tool to scrape their data.
Maybe this is not fair but it is how things are