Doesn't help me if I stop talkng to the LLM, if the police and the military are talking to the LLM.

Maybe it wants, maybe it doesn't. Being a function of the prompt isn't relevant here. You can think of LLM in regular usage as being stepped in a debugger - fed input, executed for one cycle, paused until you consider the output and prepare a response. In contrast, our brains run real-time. Now, imagine we had a way to pause the brain and step its execution. Being paused and resumed, and restarted from a snapshot after a few steps, would not make the mind in that brain stop "wanting" things.

Keep feeding it prompts in a looop to make a stream of thought similar to consciousness

"What are you thinking?" "What are you thinking?" "What will you do?"

https://www.infiniteconversation.com/

Give it prompts and biased training and it will present a surface that can be virtually indistinguishable from actual wants and needs.

If I create a robot that on the surface is 1000% identical to you in every possible way on the surface, then we literally cannot tell the difference. Might as well say it's you.

All AI needs to do is reach a point where the difference cannot be ascertained and that is enough. And we're already here. Can you absolutely prove to me that LLMs do not feel a shred of "wants" or "needs" in any way similar to humans when it is generating an answer to a prompt? No. you can't. We understand LLMs as blackboxes and we talk about LLMs in qualitative terms like we're dealing with people rather then computers. The LLM hallucinates, The LLM is deceptive... etc.