Hey, you've got it easy, you're orange :)

Ok, that's an attempt at humor, which I understand is risky in and of itself. But seriously, orange or not is really not relevant, what you have to say is. The more visible distinctions there are between users the more people will be given an incentive to try to game the system.

My 'alternative' would be the exact opposite, remove all distinctions between users in the layout, including the visibility of the 'points', use the points system out of sight to give/remove functionality and to influence the order in which comments and submissions are sorted.