I think plenty of people have problems with the second one but you wouldn't say that means they can't think.
Until we see an LLM that is capable of this, then they aren't capable of it, period
That's the difference. AI cannot be held responsible for hallucinations that cause harm, therefore it cannot be incentivized to avoid that behavior, therefore it cannot be trusted
Simple as that