If there really were fundamental differences, that would not be possible. When I take someone elses viewpoint or way of thinking or anything else that is fundamentally different from what I know "into account", what I really take into account what I imagine that other viewpoint to be, cobbled together from the things I do know. I don't say this to contradict, I think empathy goes a long way and is a very real thing, even though it doesn't mean we magically see things how others do. And luckily we have communication. We can make our own viewpoints and feelings clear, and encourage others to be open about theirs.
I'm wary about fundamental differences and all that.. spectra, maybe (I'm not sold on mutual exclusivity at all), but even then certainly not with one dimension and two poles -- but assuming it were literally that way, then there would be only halves, and nobody with an overview. Just abstractions about the other, which are useless, realize the self and let the other self self-realize, communicate, done. Sorry for sounding like a hippie, no dig against hippies intended. It's really hard to talk about this stuff, but not for political correctness and not for the assholes who take all sorts of things and misuse them anway, just in general.