I believe the main issue in regard to LLMs is that there is a real chance of the prevalence and ease of use of LLMs to erode critical thinking skills. Regardless of boilerplate warnings to "check the validity of answers" coming from the LLM, plenty of people in society outside of this tech savvy audience wouldn't even know where to begin. There was a recent Big Think article on this: https://bigthink.com/thinking/artificial-intelligence-critic....
To be fair, I do think there are plenty of uses for LLMs, but with adoption skyrocketing there really are no guardrails against misuse.