> The LLM should simply cite its sources
I like your reasoning. Wikipedia and language models are the same because if you imagine in your mind that language models were completely redesigned from the ground up so that they worked like Wikipedia then they would be very similar.
Like cats and dogs are the same thing because the cartoon Catdog exists.