This acutely describes nearly all of my childhood, up until about age ten. What little I remmeber vividly is only extremely traumatic stuff: being lost at Stanford on a game day, physical abuse by a relative, my doctor trying to explain to me what cancer was, later on a discussion of the surgery I needed, a corporal punishment episode from a teacher when I was in kindergarten. Other than things like that, I can barely remember words associated with my home and schooling and family, let alone images. Until maybe age 10.
I wonder if that's a linked phenomenon. Most people I know do not have a gap that large in the memory of their early development.