I am also like this. Why would I remember that? I don't remember almost anything I don't work to remember or is unusual. It's amazing to me that people do.
(I also have aphantasia and find it extremely difficult to believe that the entire thing isn't just a misunderstanding of language.)