A better way of framing it is authoritarian-libertarian. Some authority is useful, but too much is highly corrupting.
Currently a section of the left is rather authoritarian and dogmatic. In the past the same has been true of the right.
Nazis are literally holding rallies in downtown Charlottesville with torches and yelling kill jews. One just ran over people counter-demonstrating in the streets. But yea it's the left who are a threat.
We have a president who refuses to condemn white nationalism. He has repeatedly issued calls to violence and wants to rough up journalists. But yes, it is the left who are endangering our free speech.
A close advisor to the president, Gorka, wore a Hungarian nationalist pin to Trump's inauguration - this group were nazi collaborators. He says that the bombing of a Minnesota mosque could've been a "false flag" and he has refused to condemn white nationalists. But yea it's the left who are a threat to our wellbeing.
You're observing a response to authoritarianism on the left. We can expect increased conflict between ideologues on both sides of the political spectrum.
The actual number of neo-Nazis is very small but we hear more about them because they're the greatest troublemakers and because of history.
There are many disgruntled conservatives and former lefists who are also upset about authoritarism on the left. The neo-Nazis are using their sentiment as fuel, so to speak.
We can see a similar thing happening with Antifa emboldend by the current clout of social Marxism.