It is a security problem for the recipient.

Imagine a dissident / whistle blower / journalistic source using gpg. I could send her a message, signed with a new key, and just wait until her gpg executable contacts my server.

Then I have her IP address, and if I am lucky, I can plant an exploit into the very first request response.