All our measurements of time refer to the movement of matter: the rotation of the Earth, the orbit of Earth around the Sun, the swinging of a pendulum, the vibrations of a cesium atom.
Time travel is not possible. It would require the re-arrangements of atoms into exactly their former position, which is precluded by entropy. Too bad.
There is no past or future. There is only the forever "now".