What's wrong with this simpler explanation:

There are several time arrows, expansion of the universe, entropy increase, and your perception of future and the past. The last two are not independent at all, as your perception of the past is based on the memory which in turn is a chemical process that follows entropy increase. So the answer to "why things do not happen backwards in time more often" is that because your perception of direction of time is always aligned with the entropy increase.