That would put the responsibility on the user to remember all that. If I decide to do something like that, I'll need to save the original myself, and allow the user to go back to it.
But yeah, now I get the appeal of having something like this. I've added it to my todo list -- if enough people want this, I can certainly implement it (it would disrupt quite a bit of my internal workflow, since I view "videos" as constant, and optimize them as such. so I would need to find a workaround for editing in place, but it's certainly doable).