I guess I'm drawing on memory, but not visually. Try closing your eyes. You probably still have a sense of the shape of the room you are in, without actually picturing it right? Like you know how far away the walls are and where the bookshelf is. It's similar with faces. I have some sort of "model" of her face in my head, there's just no visual component.
And as I read that over, I realize it's a terrible explanation. I have no clue how to respond usefully.