Also the words in question are not used to address a person. When I am speaking to a person, regardless of their gender identity, I use the second person pronouns you, yours, or yourself. These are already gender neutral. The requested gender neutral pronouns (xir/xe/ne/???) are used in the third person and lower the value of communication as there is no asexual physical presentation, people present as men or women based on their fashion and physical characteristics. Going to a restaurant and saying to the attendant that you are here to me "that xir over there" does not help them figure out which table to take you to.

Not to mention that people who feel gender neutral are still male or female (or have experienced a physical developmental disorder, humans are dimorphic after all.)