Honestly a pretty bad video by Veritasium standards.
Consider the nuclear reaction metaphor. It's clearly not memoryless. Eventually you'll run out of fissile material.
The diagram for that example is bad as well. Do arrows correspond to state transitions? Or do they correspond to forks in the process where one neutron results in two?