I think users are right to worry. I worry. There's a kind of gravity that seems to pull down news aggregators. It's all too clear what happens; lightweight and/or politically charged stuff is easy to vote up, because it requires little thought.
I'm hoping weighted voting will solve this, but I don't take it for granted.