> What strategies did you use?
I see no other strategies that could possibly work. All it takes is one crawler to get through or ignore your defenses and your work has been used to help train a model. At that point, the horse is out of the barn. Any partial defense seems the same as no defense to me on this point.
But it depends on what you're trying to protect. My concern isn't actually that my content may get reproduced through an LLM. I just don't want any of my work to be used to develop or improve these models, period.