I'm one of them. I'm of the opinion that anything useful or worth hearing, I can hear from someone with less baggage. I don't know the ratio, but Peterson has added more bad to the world that his "good" ideas do not balance out. And after hearing him elaborate on his "bad" ideas, seeing the way he thinks & comes to conclusions, if I'm hearing something that sounds good from him, I would still be skeptical to the point of tuning it out entirely because of the source.
I approach the things he says the same way I would an Alex Jones or Elon Musk or Joe Rogan. They don't have enough knowledge in the domains they like to speak in to be fully credible sources, and whatever credibility they might have is outweighed by the other shit they've said that's just outright wrong or intentionally misinformed.
The source of the information matters to me, and anything any of these people or their ilk are putting out in the world can be found from someone else who is more worthy of trust. Peterson, like Elon Musk or Joe Rogan et al, have proven enough times they're willing to debase themselves putting nonsense into the world, nonsense they're fully aware is lies and/or harmful, and have burned whatever credibility they might have had.
The people taking objection to things Jordan Peterson says may be throwing the baby out with the bathwater, but I would argue that Peterson himself cultivated this lack of trust. I will hear what he has to say from somebody more worthy of my trust & attention.