You make a good point. What if a civilization figured out how to do this on a local level? To finely manipulate particles within a small area? It would be like version control for reality.
That's why satellites clocks must be adjusted https://en.wikipedia.org/wiki/Time_dilation