I find it comforting, somehow, and it helps me to keep a healthy perspective, to think about how, Right now, I don't exist on the top of Mount Everest, or the bottom of the Marianas Trench, or on the Sun, Moon, Mars, or any other potentially infinite places. And it's not a problem.
I also don't worry about not existing almost every place and at every time that I could have existed. There is no direct pain or suffering associated with it.