Not for me. I can jump into something I understood at any point of my "education" and find my way around it with pleasure.
About rewriting memories... You do not only fill the blanks in your memories. Your brain also fills the blanks in what you are looking at, the exact moment you are looking at it.