I disagree, merely because that sounds like a system ripe(r) for abuse.
We need everybody to trust election outcome.
The thing that I think would be great about using your phone to vote is that more people would participate in the U.S., where voting is optional. Would make no difference here in Australia where voting is mandatory.
NB in an election of a government there is no central trust store. And everyone (including your grandad and thick cousin) need to understand the process and be able to verify it.