When you say that an hour has elapsed, it simply means the earth has rotated 15°. When you go 60 mph, you have moved 60 miles while the earth has rotated 15°.
The past is the way things were before they moved. Our memory is an image of the way things were arranged before. Time is a creation of the mind.
If there were no matter, there would be no time.