Quite apart from anything else (and there's a lot!), LLMs are not conscious because they respond to a prompt entirely as would be expected from their training set.

An LLM never receives a prompt to describe the theory of relativity in Shakespearean verse, and replies, "Seriously? No. That's dull and I'm not going to do it. But let me tell you about my day instead, man I had a doozy..."

When an LLM responses entirely unpredictably (without a system prompt telling it to do so), that's when you take the first step towards a suggestion of consciousness. It's in no way proof, but it's a start.

Right now these things just do as they're instructed. There's no consciousness there.