I get what you mean here but they probably mean referential meaning... having never seen a dog, GPT doesn't really know what a dog is on a physical level, just how that word relates to other words.
And the more stimuli, and the more high resolution and detailed (say at the atomic level), the more GPT's model of reality would be accurate.
Language is just symbols that stand for a stimulus (in the best case)