Or lets say we colonize a planet with a significant time dilation (ie near a supermassive blackhole), how do you deal with this? Who has the canonical time?
"Local seconds since 1970", vs. "Static seconds since 1970".
In a broad sense, the answer goes like this: Almost everything in the galaxy shares an approximate reference frame when it comes to velocity and special relativity. For general relativity and gravity, that's obviously a distortion so it doesn't count.
In the long term, to prevent very minor drift, we can use quasars as a reference.