According to Wikipedia[1], you need 501 karma points:

> Hacker News does not allow users to downvote content until they have accumulated 501 "karma" points.

[1]: https://en.wikipedia.org/wiki/Hacker_News