Granted, a typical Kaggle metagame-that-is-technically-against-the-rules is to use data from outside the dataset, which is one of the reasons winners have to be validated.
"Freely & publicly available external data is allowed, including pre-trained models"