I'll second this with one minor caveat. They're not necessarily "downmodding offenders" until proven as such by the data you're requesting. They're just the top 50 downvoters.
It's hard to read contextualization or to infer what we refer to as vocal inflections through writing; I am as guilty as anyone of the occasional "posting while drinking" (which I've noticed does tend to make my writing seem a little bit more hostile than intended); however, some attempts at humor here just end up falling pretty flat.
While we're geeking out, I'd be more interested in some kind of karma/comment metric than absolute karma.