You’re reasoning from a presumption that ‘people’ _should_ all work 9-5. Why should they, and their customers, have the same working hours?
Now whether we could have a better system -- Sure! I'm all for a better society. I'm just saying it's not the way it is because of discrimination or some other conspiracy.