Why don't you leave the room? If they ping you, you'll get invited to rejoin it.