And by garbage I mean literally data/illegible/etc. that would ruin the pretraining of the model.