> Free speech rallies have been customarily labeled by the national media (and not only) as white supremacist,

You have that backwards.

White supremacist rallies have labeled themselves as "free speech" rallies in an attempt to normalize their cause. This is a well documented strategy [1]

However, exercising one's free speech rights by rallying for a cause (i.e. Charlottesville's "You will not replace us") does not automatically make that cause synonymous with supporting "free speech".

1. https://iop.harvard.edu/forum/im-not-racist-examining-white-...