> where do we actually hit diminishing returns with clock precision?

ah yes - that would be Planck's second which can be derived from Planck's constant and the speed of light