It would come down to how important your lifestyle is to you and your spouse I guess, but if you consider an expensive lifestyle highly important then torpedoing your career doesn't sound like a smart move either.
There's also the option of a middle ground where you go to a smaller company at a pay cut in exchange for whatever concession it is that's important to you. Remote, tons of vacation days, etc. There are smaller companies that want experienced bigco talent that know they can't compete on price.