This is because unlike Signal, the wire store user contact is on the server. (https://www.vice.com/en/article/gvzw5x/secure-messaging-app-...)