How was Github Co pilot trained? None of these companies have revealed their sources. But we still know OpenAI itself trained on the google C4 and Pile databases. Who knows maybe even SciHub aswell. We have moved way past asking, well that is illegal zone. As you might know Pile has over 2 million pirated books in it and it is easily downloadable even after bookzz was confiscated by FBI.