Apple is an email authority in this case, and as third party you have to rely on their security. Same as with ssl certificate authority.