TOTP is only better than SMS against SIM swapping, a rare threat. They are identical against phishing, an enormously more common problem. For a typical user the delta in security when transitioning from SMS to TOTP is minimal.
Depends on your threat model, but unlike SIM swapping this may not be out of the reach of even a mildly technical angry ex.