I think the confusing nd somewhat ambiguous description of aphantasia, and the highly literal nature of many HN folks makes it more common for people to either think they may have it, or so question how others see stuff, so are more curious about it.
I can still remember things like layout of a room, complicated directions etc, but it comes with no visual imagery. I also like to close my eyes when I am trying to think what some complicated code is doing, still nothing visual though.
as far as i can tell, most people say "yes". for me, when i imagine my dad's face, i get a brief flash of a grin, where the wrinkles are (but certainly not how many, or in any definition), and the rough cut of his hair. there's no eye color in the imagery, for example. stronger than any visual experience when i imagine his face is something of an emotional/empathetic experience -- what it feels like to be in his presence.
from what i gather, for people like me (and maybe you) who experience "some" visual imagery but not "lots", it's just a skill like any other and there are exercises you can do if you care enough about it to strengthen it.