Indeed, the two are so different that being in favor of the former doesn't at all weaken the argument against doing the latter.
It turns out there's a middle ground between "no content moderation" and "restrict people for discussing some innocent physiological aspect of themselves they can't change", and that middle ground can be totally ok
Just like there's a totally-ok middle ground between libertarians who oppose any regulation at all, and authoritarians who want to control literally everything