The whole text of wikipedia has been included in training data for basically all LLMs since the start.