He’s mistaken. Not all people can down vote. I’m not totally sure of the criteria, I believe it’s old timers or karma points related
For comments yes, but can anyone actually downvote stories?
No.
pretty sure it's only comments you get the ability to downvote once reaching a certain threshold. Stories you can flag or upvote, but I've never seen a downvote for them.