> It's possible to exploit this: you can claim somebody else's name, and apparently get away with casting their vote.

This is made more likely by voter rolls being public. In NC, you can even see if a given person voted in a given election. Not their vote, but whether they voted or not. Which is information you could use to identify identities up for impersonating.