The message has to be signed with the private key of the key so no one but the real owner can delete it. In fact, in the readme:
> If a user can prove that a key belongs to them (by signing a message with their private key) then they are able to remove their public key with no interaction needed from the server operator. Once a key is removed, it is removed from all servers in the pool.
This is a pretty fucking awesome idea.