One of the points of the E2E security model used here is so that you don't have to trust Cisco.
I mean, whatsapp claims it has E2E encryption, but I've never checked...
I'm not sure what parts you can verify, but I'm willing to trust the word of those at Whisper. Perhaps I'm naive but they seem to genuinely care about improving privacy for others.