Sure, but I still think it's OK to look at Apple with a raised eyebrow when they say "and our previously secret training data crawler obeys robots.txt so you can always opt out!"
Apple are saying you can opt out of their training data collection using robots.txt.
But... they collected their training data before they told people how to opt out.
I don't understand why me pointing that out as "eyebrow raising" is controversial here.
It might be nice if there were categories that well-behaved bots could follow, as noted above, but even then the problem exists for bots doing new things that don't fall into existing categories.
I think that's disingenuous of them.