The difference is that, AFAIK, those bigger AI crawlers do respect robots.txt. Google even provides a way to opt-out of AI training without opting-out of search indexing.
full disclosure: worked there [edit: google] a while ago, not in search, not in AI.