In another thread not long ago PG stated that this was exactly the case on a few comments he found vitriolic. If he measured the votes of only high-karma users, the comments would have been negative. You can search through his history to find his report on the subject (it was around three weeks ago, IIRC).