I don't think it's so much comprehension that suffers. I comprehend, but...
I have no strong concept of the sensory world of the text. I have a very, very vague impression of what a character looks like. I'm prone to forget explicit features that the author bothered describing because there's no durable image to factor them into.
I notice some people have strong reactions to casting calls in movie adaptations of novels. This objection is foreign to me; I had no strong image for it to conflict with.
I am more likely to find a turn of phrase beautiful for the words and sounds, than to have any sense that the thing it describes is beautiful.