Which is exactly my point. Under normal circumstances you inexorably move towards the future. But we generally believe we have freedom of action about the spatial coordinates.

A black hole is interesting because you inexorably move towards the singularity - which is a defined location in spacetime, and also has a boundary - the event horizon.

So now your freedom of action is reduced: you must move towards the singularity, but you also can't actually move outside of the event horizon either.