“… he complained that LLM companies were crawling data without respecting robosts.txt“

Maybe that is the problem? They misspelled robots.txt