I usually have the opposite problem: I'll consider myself a friend of a person, but that person thinks I don't like them. A common side effect of being factual/honest, unfortunately.