I think the universal truth is that people have their own lives going on, and you need a way to sync up in order to accomplish goals with other people. That's why we set times for meetings.
If you are late for a bus, it leaves. The plane will take off. The walking tour will have walked away.
But I'm supposed to make my wife handle dinner with the kids because 4:00pm really meant 4:25pm and now we'll all be stuck in traffic heading home?
Normally I just listen to audible or finish some work when the other party is late. But when it starts to impact family life I get mad.