Doing things that you aren’t good at, that you haven’t effectively practiced, is tiring. If you aren’t an experienced driver, for instance, a lengthy, unfamiliar journey will feel exhausting. Once you get good, it’s second nature, and you don’t bat an eyelid.
It’s pretty simple. You don’t need to invent this concept about special types of people who are “tired” by social contact.