This will not happen. The fear comes from the real problem: publication as a measure.
The mathematics itself will only benefit from the discovery of cross links from the human created literature. Think about these LLM as infinitely patient and very long attention experts in what was already done.
So on one side, for a few years at least, it will become normal to publish tens of articles. The article inflation is what scares the present system.
On the other side, after a while, when all the existing mathematical corpus will be mined and most of buried connections will be explored, we shall have a much more better foundation for future mathematics.
It is very naive or misleading to think about mathematics as if it were chess or go.
In few year these (future) tools will be in standard use.