It's a good idea but it's not practical. It won't make a proper measure.

Sometimes I make 3 or 4 comments on a submission that I wish I could down-vote it.