Maybe I'm misunderstanding what you're trying to say, but remote attestation is in fact exactly what they're doing with their contact discovery: https://signal.org/blog/private-contact-discovery/
Oh, and I forgot, you do need to essentially blindly trust Intel.
Also, Matrix offers a possible alternative.