I find the associative nature of our memory can only be represented as a graph, but we definitely need a vector store.
I like to pose this as an identity question rather than memory as colloquially memory is only associated with fact extraction and retrieval, while identity extends that to traits, behavior, preferences, memory and narrative causal relations.
essentially a self organization of symbols and memories to produce a coherent singular entity.
I had written about it here.