You can downvote comments after accruing a certain amount of karma (see https://news.ycombinator.com/newsfaq.html)