Interesting, because based on my wife's stroke, it appears that the human brain implements language and math somewhat separately. She was a physics major and had completed 4 years of relevant college math courses.

After her stroke she lost the ability to do even simple arithmetic and also had great trouble with time and calendars.

However, her language skills were essentially intact until a third stroke in a different part of the other hemisphere left her with severe expressive aphasia. (Her first stroke left her with homonymous hemianopsia, but that's a loss of visual preprocessing in the occipital lobe.)

So I would not expect LLMs to have math skills unless specifically trained and specialized for math.