yes, they are most likely finetuning with this type of pretraining https://arxiv.org/abs/2103.10360 quite easy to build