Or searching anonymised logs for mentions of this problem and using that as part of the context or training.
This would work just as well and have plausible deniability.
Exactly! This is the real Occam's Razor explanation.
They wouldn't appear in weights but could be added to the context. My conversations regularly go "regarding your Java problem"... which was a separate item in the history from earlier. As long as I only see these (and nobody else sees mine), it can be helpful.