I don't think back propagation care whose text it is back propagating.
Instead, training attempts to sample more heavily from higher quality sources, with, I'm sure, a mix of manual and heuristic labeling.
their idioms would leak occasionally otherwise