I guess the better question is, can this skill be learned without being an extreme expert in mathematics? Can I be a sort of intelligence highschool student (not incredibly exceptional at all) and have the LLM teach me the required math for a specific problem and guide it towards a solution?

I think the answer to this question is becoming, in general, a big yes.

LLMs can arrive at a solution via two paths. The first one is via heavy guidance by an adept expert in the domain. The other path is via brute force... multiple agents (the more the faster it can arrive at a solution). The later path is what enables anybody to do this.