There are all sorts of laws that protect us from various government abuses, such as requiring search warrants, trial by jury, freedom of speech, etc. Voter secrecy is a prudent safeguard along those same lines.