That's just distasteful to delete data. Just encrypt it with a public key.