We _might_ be on a timeline in which some time travelers appear some time in the future, but maybe not.
It's sort of like the question 'why did life arise on Earth and nowhere else that we are aware of?' - the only reason we can ask the question is because we are the result of exactly the factors that would produce a consciousness that _could_ ask that question.