The amount of undue hate that people on the spectrum get for being sociopaths or narcissist is awful. You are correct that they may misunderstand or "not get" social situations. You are incorrect in that they don't care / can't feel the emotion of a situation. Often they are overwhelmed by this and it's what makes "dealing" (passing as NT) difficult.
The amount of times I have had people socially manipulate situations against me is difficult to count. Any time you speak up about this you are the "crazy" one. These have mostly been situations where sociopaths are abusing me for the entertainment / social benefit reason.
They DO NOT CARE about the pain / suffering they cause. This has been a source of extreme stress, pain and suffering in my life. YMMV obviously but the amount of time I have to spend explaining this to people is disheartening. It's like nobody wants to believe that people can be so awful... and this belief can hand wave away any bad behavior being described.
> because even if you have little empathy, behaving like a creepy scumbag is generally not going to be beneficial in the long run.
I think you significantly underestimate the benefit to risk ratio. There are a lot more terrible, manipulative, sadistic people out there than "kind but misunderstood" people. The averages are not in our favor.