Do you experience dogs as lots of action potentials traveling along axons and lots of neurons doing their thing in your brain?

I don't know how it gets from the physical processes or the information processing to our first-hand experiences. So, I can't be sure that a bunch of high-dimensional vectors can't lead to experiences.

Regardless, the claim "LLMs deal entirely in symbols" is wrong as a matter of fact.