I feel the term "deleting" is misleading.
It's more akin to "hiding" - to me, deleted means unrecoverable, by anyone, at any time.
Even your OS doesn't "delete" files, until the actual sector on the drive is overwritten (depending on media used, of course).