I
like the idea of tying it to the CMB value. Determine the rate of change, factor in the observed rate of universe expansion, etc.
The real problem is that we need a point of reference that is external to our own frame of reference. Luckily, we have one.
Light.
Light moves at the same speed no matter what your frame of reference is. It's theorized that the early universe was dark for a very long time because any emitted photons were absorbed by other matter, because things were so dense. After a while, matter got ionized and expansion kicked in and the universe cleared up. This was the time of the first stars.
So, we need realllly good telescopes. Fortunately they're being built. The idea is that you have to find the light from the first stars. Measure the redshift and find some type 1a supernovas from the period to give you distance. (Standard candles.) Then you have a base measurement of time.
One problem is the redshift. There was a recent paper talking about how the earliest galaxies are so redshifted by now that their light is getting lost in the CMB.