With some important caveats, this situation is what remote attestation / SGX secure enclaves are hoping to improve.

https://signal.org/blog/private-contact-discovery/