In the same way that I don't care about skin color; I also don't care about features continuing to exist and be diverse.
As mentioned, I recognize that we're in over our heads technically. I respect that if we were to "wipe something out" it very likely could end up a huge negative to humanity, due to unknown genes and etc.
However the discussion largely took a moral twist when racism/etc got brought up, and frankly I just don't care. I'm not one for history; so the moral implication of not having a physical-feature-group of humanity around, be it freckles, blue eyes, brown hair, light skinned, tall people or whatever, is entirely lost on me.
Humanity from my perspective seems far worse off having cared so much about our differences that I see little reason to be morally concerned about their absence. I imagine we would be better off for it, since we clearly fail with diversity now, it's not buying us any favors.
Likewise, with or without diversity, we will still certainly find reasons to hate each other. The conversation will just change. We're good at hate.