Refuse to Skype. Works for me.
I actually just worked out how to solve this problem. I am downloading the Android app.
Its in the web browser using WebRTC, and with end-to-end encryption. It's free and good quality, and you can play lunar lander while you are waiting for the other party to join.