That's because gravity slows down time.

So the higher you go, the less you're impacted by gravity, the faster times goes.

See https://en.wikipedia.org/wiki/Gravitational_time_dilation