How do you define "LLMs don't understand concepts"?
How do you define "understanding a concept" - what do you get if a system can "understand" concept vs not "understanding" a concept?
How do you define "understanding a concept" - what do you get if a system can "understand" concept vs not "understanding" a concept?
The idea that "understanding" may be able to be modeled with general purpose transformers and the connections between words doesn't sound absolutely insane to me.
But I have no clue. I'm a passenger on this ride.