Contrast the "media noise" of Woz with Jobs.
There are hundreds of reports from colleagues, family, friends about the characters of each of these people. They are completely different.
There is video evidence confirming these judgement. There is video evidence of Woz going around being a pretty sweet guy. There is video evidence of Jobs berating people and being mean.
Should we--the unconnected public--pretend that we can't know anything about these people just because we haven't met them?
It's not true that you have to know someone personally to judge their character.
We, the masses, don't judge people by how they treat their friends, superiors, or other rich, connected, powerful people (like you).
We judge them by how they treat the little people.
Being mean is like being trustworthy. Sometimes it only takes one sufficiently mean act to become a mean person--especially if that mean act is toward a little person who can't do anything to fight back.
You're a modern aristocrat, Paul, whether you like it or not. Not every aristocrat is abusive but one trend throughout history is that the kind aristocrats usually protect the evil ones. The servants know the difference. The nice aristocrats are ignorant. The mean artistocrats pull the wool over the eyes of the nice ones. If the servants complain about the mean ones, the nice ones side with the mean ones. Class solidarity, willful ignorance, or both?
I am very sure this is what is happening in Paul Graham's case, and likely yours too. You are apologizing for the cruel aristocrats because they don't show you their true colors.