There might be more value in having LLMs systematically hunt for mistakes in existing and widely assumed correct math papers, or hunt for counter-examples to things thought proven. There's likely to be a couple mistakes hiding in the less well scrutinized corners of mathematics.
Maybe something interesting will fall over because of that, who knows?