I don't think LLM companies need permission to scrape Reddit. It's ironic because Reddit is basically saying "you can't profit off user content for free, that's what we're doing!"
Is it the case that companies are allowed to scrape data for profit under US law? I was aware of the LinkedIn ruling setting a precedent for scraping public facing data, however, I wasn't sure if it applied within any scopes.
(not a lawyer, not legal advice) The Supreme Court determined that the CFAA doesn't apply in a particular way to scraping public data. You're still probably in hot water if you violate copyright or other laws, and you're still probably in hot water (as in the LinkedIn case) if you also scrape non-public data.
Except that’s not what’s going on because they pay millions or more in busting fees and staff ?