From the FAQ:

  Why don't I see down arrows?

  There are no down arrows on submissions. They only appear on comments after users reach a certain karma threshold.

I believe it's around 500 points.