Karma in general is a poor metric of quality, and the way that downvotes are being gated from users not catering to popular opinion pushes out these voices that may not necessarily be fringe, but just unpopular at the time. This is a feedback loop, and only creates environments where people do not feel comfortable speaking out.