I happen to think the opposite. I know it's unpopular.
Downvoted posts are distinct markers that shape our experience. But we're warned to not discuss it; the very thing that controls how we see and what we see (or not see). Apparently that's boring.
Voting systems create echo chambers. Most people vote based on subjective agreement, not on objective quality. We need to be aware of that, and discuss it. Just my opinion, which I'm wary to post but will anyhow.