I have been friends with a couple people with clear sociopathic and psychopathic tendencies, and this is absolutely true. Most have been trained to seek social inclusion like the rest of us. They just suck at it. The lack of empathy is a strength while running a con or worse, but a serious handicap when trying to build long-term social relationships. It's downright pathetic to watch them attempt their social cons on people who are intelligent and self-aware. If you know your own weaknesses you know when someone is trying to attack them. When it's malicious the psychopath gets the boot fast. When it's a harmless attempt to fit in, it just puts the psychopath in the awkwardly manipulative category. The lack of empathy means they often don't know why they've been ostracized.
FWIW, I have the opposite problem; a little too much empathy and guilt, but it gives me the same talent of seeing the weakness in people. Which is why I'm friends with them. They use my empathy for friendship, and I let them because it's absolutely fascinating watching them work.