Sounds about right. I thought it was pretty 'normal' to feel this way sometimes...
I’m not a psychopath, but I have high levels of social anxiety and probably high functional Aspergers. Every situation I didn’t rehearse in my head is incredibly exhausting, and even then, if it gets too complex I feel the urge to withdraw — and it doesn’t matter whether it’s a jerk coworker being a jerk or someone I like dropping a compliment bomb on me, or even, if I’m not the best shape, a partner being affectionate.
We override our deficiencies, but it’s tiring.
If someone calls me on the phone then I can have a good conversation, palpations and sweating aside. However if I have to call someone then unless I do it immediately whilst suppressing the desire to think about what I'll say I go to complete mush and procrastinate my way to distraction. Mainly it's one-to-one I have a problem with.
I'm guessing you're an introvert, right? It seems to me that most introverts experience social situations as "draining".