In theory, you can add some more complexity/fragility and have 'time notaries' sign the current time together with a challenge from the passport, verifiable against embedded public keys.