With that in mind, picture how annoying it would be if you crossed a timezone line on your way to your (or your child's) school. Picture how annoying it would be if half the restaurants, shops, and businesses in your town were in one timezone, and the other half were in another. These issues are what timezones address, just on a governmental level.
Timezones don't try to be "correct", they try to be useful.