I have a theory that Aphantasia is the symptom of something else, and this other thing relates to how the brain of such individuals stores information. I think it's stored in a more "compressed" state.
As an example, I find myself remembering where info is and not what the info acrually was.
Humans are not homogeneous. I think this is a huge evolutionary advantage, different mental modes improved our survivability.
But of course in modern day life such "divergence" can lead to pathology.