Let me be clear - I clearly do enjoy the game of accumulating karma points, but I enjoy the game of speaking my mind far more.
I've seen plenty of controversial arguments (some of which got downmodded to hell too) from other "high karma" people, so I don't think this is a problem here, though it may be a problem in other communities.