Well, first, it'd probably be a phone-primary payment world, not a phone-only payment worldThat's just moving the goalposts. The whole point of the original post was that moving to a phone-only payment world is a bad thing, and that's what is happening in some places (China is only one).
I see no scenarios where my risk exposure is significant in a phone loss or breakage scenario.
Then I submit that you lack imagination.
Here's a scenario: You're in a country you've never been before. You took an Uber to a restaurant recommended by the hotel concierge. Food was great. You pay with your phone, then leave.
In the street as you try to text your wife a picture of the awesome food, a passerby bumps into you and your phone goes through a sewer grate.
You now have no phone. You can't summon another Uber because you don't have access to the app. You can't call a cab because you can't pay for it. You can't take transit because your transit pass was on the phone. You can't walk back to the hotel, because your map is an app. You can't talk to the locals because your translation dictionary is an app. You're screwed.