Nazism cost millions of Germans their lives, led to one of the biggest campaigns of genocide in history and wrecked the economy, social structures and world perception of Germany for decades. So the question about it isn't so much "is this thing dangerous?" as "how can we best keep this dangerous thing from getting loose again?"
(Which isn't to say that banning it is necessarily the right way to do that; many have argued that banning it just gives it an air of uniqueness that makes it more attractive, rather than less. But nobody making that argument would go from there to say that Nazism is somehow morally neutral.)