Flagging is not a mechanism for people with minority opinions. Rather the opposite. It is used by people in the majority of today's moral climate to stifle the exact minority opinions that should be protected. It creates an anonymous veto power for the status quo.

The other point is whether the flagging is legit, or being influenced by special interests. If the same X number of users were flagging everything related to Y, there is no way to know under the current system.