Well, there's "completely unable to find work" and there's "unable to find good enough work to make the move worthwhile" - especially if your salary (or lifelong dreams) depend on you using your unusual specialist skills.
Let's say I'm an expert in discovering new drugs, and my partner is a dancer for a professional ballet company.
For me to take a job that ended her professional career (or vice-versa) the payoff would have to be huge.