Or searching anonymised logs for mentions of this problem and using that as part of the context or training.

This would work just as well and have plausible deniability.