The only problem here is that you are assuming only one point of view is correct. So if I down vote you because I believe what you are saying is wrong but a lot of supporters of your view up vote then I will be punished for having a discenting (or at least less popular) view.
Is this what you had in mind?