Not only are you wrong (LLMs are horrible at reproducing anything that isn't fairly ABUNDANT in the training data), but it's also quite sad.
AI can write a whole book on anything. You can take anything, even make up a phenomenon, and have an AI write a whole factual-sounding book on it.
How that isn't clearly an indicator to you that it produces loads and loads of BS, I'm really not sure.