On top of that if we did not ground one side of the electrical network, you could touch either wire and feel nothing. That's called an isolated ground, and is not commonly used except in hospitals and some other specialty settings.
(If you wonder, we ground one side because if two different people both happened to touch a wire, current would flow between them using the each.)