I believe it changes over time?

I used to be able to downvote as I hit the 200 mark, but now I am well over 300 and can't downvote.. Perhaps it is related to the time spent on HN?

It went up to 500 not so long ago.

Nope. I'm nearly at 400 and I can't find a downvote button anywhere.