We actually live with about +/- 15 minutes of drift (of local solar noon vs. 12:00 local mean time) over the course of a year. See https://en.wikipedia.org/wiki/Equation_of_time
And timezones one hour wide impose about a +/- 30 minute fixed error (and sometimes larger) on top of that - the difference between local mean time and local civil time.