Stop thinking about text being the data. There are so many other sources, even some that you can generate.

https://arxiv.org/pdf/2506.20057