Theoretically, someone could exploit a vulnerability in the SS7 [0]. I’m not sure how common these are in the wild, but it had happened before.

[0] https://en.m.wikipedia.org/wiki/Signalling_System_No._7