Maybe the "raw" record of our experiences is stored on a separate layer. I mean, I can close my eyes and flip through a series of images from my last 12 or so waking hours. They seem more like snapshots than a description of what I saw/where I was. Some people may have actual photographic memory [1].
Who knows, at some point in the future people may able to opt-in for implants that record everything around them, at a greater accuracy than brains, but use the brain for storage.
Some people have a better memory than others, and most people prioritize what they remember in significantly different ways. They may be good with names, bad with faces, or vice-versa. They might not remember particular dates, but will remember the weather.
Even people with a very good photographic memory might be blind to things. What song was playing there? What did they say to you? Did the place smell like anything in particular? What were you feeling at the time? What was the temperature like? Was there a draft? It's rare to find someone who's paying attention to everything, all the time, and taking notes mentally.