You'd calibrate the timing of the pulsars before launch.
EDIT: On second thought, using an accurate clock would be a tiny fraction of the cost of the whole system, so it's a solved problem.
https://www.nasa.gov/sites/default/files/atoms/files/session...