Isn't it impossible to really delete something from ipfs? I'd think that would make this dangerous, as any security flaw would be impossible to fix retroactively. Everything before the flaw would be compromised and can't be reencrypted safely.
If a passphrase was lost, the security of every past file would be at risk.
This is what has kept me from approaches like this in the past.