You don't need to move 3,000 miles away, you just have to move outside of commuting range where the prices fall off a cliff. You can still live in the same quality house and see your family frequently.
It's nuts to tax Joe Worker who needs to live in that area to get to work double or triple the property tax of the rich old guy next door who spends his days playing golf or w/e.