I have aphantasia, found out 9 months or so ago, but can meditate fine. The main point is to focus on nothing, the sound of your breath can be used instead of imagining a flame or sphere or whatever. Another technique is to tap everytime a thought comes into your head, and dismiss the thought.

I also voraciously read fiction, so I doubt you not liking it has anything to do with aphantasia, but find overly descriptive portions of text boring and will often skip them.

Also, you can almost certainly learn to visualize with your mind's eye, very few people have actual incurable aphantasia from what I've read. I did some exercises, image streaming, and it was starting to work. After a week or so I started seeing images. I had too much on my plate, so parked it for now.