Agreed, it seems odd to be a fan of a team when they aren't "your" team, as in you can go and actually see them on a regular basis.
Racing and golf are examples of successful sports that don't have geographic ties, and they're both mostly individual-driven. Racing has teams, but nobody really cares about them.