It depends. One prominent figure of the right-wing populist party AfD in Germany has been called a Nazi. When he sued the originator the court decided that, considering the circumstances, was not an insult in the sense of the law.
But in general if you were walking down the street or talking about something on the internet and somebody else called out or posted and said you are a nazi. Hate speech?