Probably. Apple published a paper back in 2017 about improving synthetic data for the purposes of training models (though not transformers).
The examples they give are for eye and hand tracking -- which not coincidentally are used for navigating the Apple Vision Pro user interface.