"these guys are sons of wealth, I can't imagine they've ever known serious privation in their lives, and they're trying to squeeze still more money from someone who, much as I dislike him, earned it by working his ass off."
True, but with a few asterisks.
First: Zuckerberg himself didn't exactly go hungry as a kid. AFAIK, he came from a fairly well to do -- probably upper middle class, though certainly not Winklevoss-class -- background.
The class angle certainly makes unsympathetic villains of the Winklevosses, but their actions -- not our best guesses at their upbringing -- are the real reasons to revile them.