Now, I don't feel like I have a particularly great memory, I just imagined everyone could recall many different things from their childhood.
However I've noticed in the last few years both my SO and my mom often utter surprise when I recall some episode from when I was a kid, like "wow, you remember that?" Almost makes me feel like some weirdo for recalling that early stuff.
As to the topic at hand, since I do recall a fair bit from I was 4 and up, I'd say the time I spent with my parents before I was 12 definitely shaped me. So while I don't recall details of may conversations or similar, their parenting and behavior left a lasting impression.