There's a difference between what all these people are warning of, and then "literally Hitler" of starting a world war and imprisoning all political opponents and then executing millions of the prisoners like cattle in an industrial processing plant.
The "literally Hitler" smear is an attempt to distinguish that careful, and important distinction, so that the entire thought can be dismissed as ridiculous.
Looking at each of those articles where they say "not hitler, but he still is making noises like he'll be bad," do you think that needs to be walked back? Were they ignoring reality, or facing an unpleasant reality?
"Literally Hitler" is not a thoughtful, fair, or even useful characterization of these viewpoints.