There are several ways to avoid this.

1. The buses have predetermined stop times, signalled by a beep. You don't get on in time, you don't get on at all. Makes the delays predictable, regardless of the number of passangers.

2. Lines go from A to B and back, rather than in circles, so the delays cannot accumulate.

These are known and widely used. There is no reason why this should happen.