Yes, you can and should "both sides" this.
Maybe you're unaware of what's happening with the extremes on both sides, but they're feeding off each other and rapidly regressing (thanks in large part to Facebook/Twitter). While each is enabled/emboldened by the free pass from their side, who are either unaware of their own extremes or just more afraid of the other. It's a negative feedback loop and we really need both sides to start pushing back on their own.