Here is something for all to ponder. Remember when someone switched the TV channel into the middle of a movie you haven't seen for 20 years. How long did it take for you to recognize the movie? And how often did you have a good sense of what is next? Most people report "a second or so". Think about this: when you saw the movie you were not trying to remember it, you did not know you would be tested 20 years later.
One way to think of this is that it is highly likely that memory is not the problem to be dealt with, but that recall is.