So far most of this pollution is effectively tagged through accompanying mentions of "GPT", but filtering that from future training data would mean GPT can never learn about itself.