Technically we also trust Signal not to push a signed update to their software that exfiltrates our keys. Whether or not Meta is doing E2EE should be clear from snooping their protocol or reverse engineering the software.
You don't even have that option with closed source software.