¯\_ (ツ)_/¯
You're downvoted here because others disagree that someone that is greyed out must have said something very wrong or worthless, but that's not a very wrong or worthless opinion. Only naive, perhaps.
I try to use downvotes rarely, and only for "egregiously contravened community guidelines" not "expressed opinion I strongly disagree with"
Keep participating! Downvotes (and flags) are not generally a big deal if your overall contribution is positive
Or there was an attempt at irony by the downvoters. That sometimes happens. You discuss downvoting at your peril. <dons helmet>
The downvoting system is indeed pretty witty, in that few people can downvote, but a lot more can undo the downvotes. I can't downvote myself yet, but I do check downvoted comments and when I feel that it got downvoted by personal bias, I simply undo it.
And usually don't follow up on what happens next, so whether it gets downvoted again or not I wouldn't know. But then I don't care that much, in most cases.