Interesting idea.

Lots of people have also wanted to be able to give more than one upvote every now and then, say 5 extra upvotes in a day. Your idea may solve that elegantly as well. You can give as many as you want, but they come out of your karma.

The real challenge is to avoid complicating the UI.