> can you explain your reasoning as to why a language model would never be able to match a human's ability to explain its reasoning?

It’s a language model, not a reasoning model. A lot of its training data happens to be logical, so it sounds logical, but it’s still just acting on probability. Thinking it’s “explaining” anything it produces is a mistake.