Maybe have points become visible after you upvote a comment? That way there's no influence on which comments to upvote, but you get some validation.