Oh wow, this is a great idea. How do you deal with the lossy compression? There must be a lossless codec which uses the redundancy better than deflate?
What you're suggesting with a lossless movie codec would be a great addition, we just haven't had the need for it yet.