Yeah, this is throwing the baby with the bathwater. I am with you, if you are talking about "designer babies" etc. A basic Google search will tell us about studies where vast majority of Americans are okay with even gene editing, to prevent diseases, but not for performance enhancements.
It is a tool, like guns, bombs and medicine.