That's why MPEG defines "I", "B", and "P" frames (well, one of the reasons).