Sounds perfect - thanks.
Presumably after several hours you could discount the votes altogether since they would have such a little influence on the final result. That would stop the system getting bogged down over time.
Out of interest, what is your "and so on". Do you go to 0.5 for the next 2 hours?