I'd guess this is only true if you're in favor of policies that are against other, targeted, groups or people. And that sounds okay to me. That's pretty equivalent to being an asshole. It's normal for people not to like you if you sound mean, unpleasant, and appear to be threatening.

If you're being isolated and marginalised for opinions that aren't themselves marginalising, then there's a real problem.