I'm also a Swede living abroad. I have signed up with Swish using a non-Swedish phone number (but with Swedish bank account), it works fine in most cases. I do have an address though, but not in Sweden.