What are you defining as "the" margin of error?
http://en.wikipedia.org/wiki/Margin_of_error#Different_confi...
In reality, you should apply a finite population correction, which would make the "margin of error" a bit smaller if you get a substantial percentage of the population voting:
http://en.wikipedia.org/wiki/Finite_population_correction#Co...