Every time? If a person never used it I think he or she might sound stilted, since he or she would need to alter his or her speech in order to avoid the pronoun he or she wanted to avoid.

To each his or her own I suppose :)