I live in the bay (but not SF), and the biggest thing that would would give me pause here is that I don't want to live in Boise, Denver, or Phoenix.
Some people are fine with living anywhere. Others are looking for good weather, a specific culture, or something else.