It isn't just code, all AI models need to train on equivalent of low-background radiation steel, before the nuke was detonated(or ChatGPT was released to public).

That is generally a problem with all AI right now.

Didn't people prove that MSFT trained it on private repos too?

Not factored into OKRs, unfortunately. Maybe next time. Or never!