Exactly how does dialogue with white nationalists help the rest of us grow? Their goals are to remove, silence, or destroy people that have different immutable characteristics. How do you suppose that impacts free expression?
So, no. Either everyone is censored or no-one is. I vote for the latter, let the law decide what is allowed and keep it at that. If it isn't forbidden, it is allowed.
[1] this is not a joke, see https://www.vox.com/the-goods/2019/2/25/18234950/knitting-ra... where they seriously talk about 'Fiber artists of color' (?) pointing out the 'racism' (?) in the knitting 'community'.