As cool as that would be its probably not doable because gpg doesn't support curve 25519, which is what signal uses for its authentication keys. So either needs gpg decides to support the curve or hardware keys need to explicitly support either signal or the 25519.