People already follow others to downvote. I suggest the opposite: Remove all usernames and points, making it more like 4chan. I think that could be quite valuable.