It strikes me that having a duality of political groups like this doesn't mean they both have equal legitimacy or deserve equal platform.

American conservatives have pretty eagerly woven prejudice into the ideological fabric of the party. Similarly the party seems willing to promote or at least enable blatant criminality.

They made their socially-regressive bed and now they can lie in it. "Fiscal conservatives" who don't see themselves in the rest of the picture would be right to feel disenfranchised.