Can you accurately draw something while looking at a photo of it? Most people can't. Seeing something and drawing it are obviously different skills.
What you may not understand about other people's mental visualizations is that they're somewhat fuzzy and unstable. It's very difficult to zoom in and out or to focus on the details. The better you know something, the better you can visualize it. There are also degrees of the ability -- some people are very good, and some aren't.
> Other people think they have a visualization but do not.
I know someone with aphantasia, and he was confused about whether or not he had it for a long time. I think this makes sense: you can't imagine being 100% certain you see something in your mind because it's a "sense" that you don't possess, so you assume other people aren't certain.
I assure you that you're absolutely wrong. I am absolutely certain I see things in my mind and that it's common for people to be able to do so (with varying degrees of stability, accuracy, clarity, etc.). Especially faces, I can see them very clearly. It is somewhat a function of memory.