I'm not sure what the threshold is for being able to downvote stories, but it's pretty high.
Those that have that power have a great deal more control of the front page than those of us that don't.
We're relegated to trying to exercise our power through snarky comments and distracting meta conversations about the voting system.