I read your reply a while ago, but still can't wrap my head around "t feels like I am somehow less than myself if I don't remember them.". I forgot many things, and it's quite ok with me, so I'm trying to understand your view.

Are you trying to remember everything all of the time? Including all of the new memories?

Suppose you are able to record calls and face-to-face interactions. Are you going to spend hours of your life re-watching or fast-forwarding through mundane everyday things?