I agree completely. It is a real shame that nowadays so many people do not assume good intent, or if they do, they value the intention much then the Deliverance. There are definitely a small number of people that intentionally use terms that others may find distasteful or offensive, but the vast majority of people are not trying to do that. They are just using the words and vocabulary with which they are familiar.
The more time goes on and the more experience I get the more cemented this becomes. The best example is the expression you guys. Nowadays that expression is fully gender-neutral and is routinely used to refer to a group of mixed gender individuals. Some people can feel excluded by the term, and for that reason I do often try to substitute a different term for it, but many of the women I work with use the same expression of you guys even when referring to a group of entirely women. I strongly wish that most people would hear that and not think of a gendered reference. I think that would radically improve communication.
If there is doubt about what the person meant, sometimes a clarifying question can be extremely useful. For people that are trying to use offensive or exclusive terms, it is good to push them on that a bit and ask for clarification and such. But I don't think I've met anyone who was using the term that way in many, many years.