I'd recommend looking for other sources of information if you're relying on someone who co-authored the paper that introduced the most misleading and uninformed term of the LLM era: "stochastic parrot".
in this paper, it's clear that the authors don't think modern LLM-based systems are just stochastic parrots.