I believe HN takes a holistic approach and takes other criteria into consideration. My downvote button was activated after my karma reached 500.