Isn't the whole point of attention, some context comprehension in the stochastic parrot machine.
Consider context as hyper-dimensional coordinate vectors gesturing at the starting concept cluster of a synthesis chain or thread to unspool.
If the model's comprehensive training activated by your context locates the right thread to pull, this could be considered comprehension? That it "got" it?