HN's voting system is a bit complicated. They will remove the downvote button for various reasons. For example you can't downvote replies to your comments, only upvote. I think also if you are a newer user, you can't downvote.

You have to have >500 karma, iirc.