My guess is that multimodal training could be useful as a pretraining strategy