I find that I often instinctively head to upvote a comment that has hit its critical mass in terms of karma votes regardless of its content. I have to take a second, back off from my instinctual action, and evaluate. Often I end up upvoting it anyway upon reading it, but at least then I have taken the time to evaluate it myself.
Not having the points present makes this problem go away because there is no implicit "lots of people like this, I probably will to" reaction. The jury is still out on whether or not I think things are ultimately helped or hurt by the move but I believe it is worthwhile for the sake of experiment if nothing else.