If I were creating my own ratings for my own personal view of HN, I'd like to discount votes of people who vote opposite of me: if I downvote a comment that they upvote, then I'd prefer to take their other opinions less into account.

Or, since I'm not actually all that active on HN, I'd prefer to be seeing a view that weighted more heavily votes of people who were not voting opposite to those of people whose opinion I respect, such as pg. And probably some others that I'd be aware of, if I were on HN more.

For me to take the next step and suggest that this then becomes the default view that everyone sees seems strangely egotistical. Not for me, I mean, but that you might seem egotistical if you were giving more weight to votes from people who voted similarly to how you voted. I'd probably like the site more if you did that though :)