It doesn't matter... depending on what social circles you're part of, and/or where you live. That's a crucial distinction.
I think it's very understandable to underestimate the degree of suffering involved, and how much this can be improved over time through publicly voiced support, especially when it comes from influential figures.
Many of us make this mistake in regards to women or ethnic minorities too. And those of us who are good looking do it to those who are less pretty, and those who us who have always been popular do this to the unpopular.
The best kind of empathy, I believe, concerns not just your feelings toward others, but also the context that these others are in.