Caveat: In countries that adopt an AI-aware copyright statute. In other countries they will just scrape whatever-the-hell from wherever-the-hell.
Right now all we're seeing is gentlemens' agreements and self-enforcement. A robots.txt is just asking you nicely. I don't know of any country that has any judicial ruling on the topic of AI scraping yet?