I like the idea but it will just end up with tit for tat down modding. It would only work if the down modders idenity was hidden from the person.

I actually think you should get a point for commenting in the first place, this might get more people commenting and joining in.