The general populace can't really verify the results of paper ballots either, that would mean letting anyone who wanted to do their own manual counts of all ballots.
It is done onsite so there is no risk of tempering.
If you wanted, you could stand next to the transparent ballot box the entire day and then count yourself.
The results are available a couple hours later. I can't think of any downside.
And a single poll worker still wouldn't be able to verify all of the votes in an election. There's still an insurmountable trust issue where most of the public has to accept the results from what amounts to a black box, which paper ballots don't entirely solve.
In Australia we have observers for the counting process and every party or candidate can send representatives. Political parties are practically begging for volunteers in this role. We also have a much more complex preferential voting system but the manual counting process still shows results 30-60 minutes after polls close in all but the tightest races.
> And a single poll worker still wouldn't be able to verify all of the votes in an election.
Anyone cheating would have to involve a huge number of people around the country and the people watching those people. Getting elected legitimately would be far easier.