LLMs can't do math in general, they need external help to do simple math problems with any consistency.
It's only with the introduction of things like Wolfram Alpha into ChatGPT for example that they can actually perform math with accuracy, because it's being passed off.