You are going too far down the woo side when it is a computer program doing ultimately what is expected of it from its programming just like any other computer program. There is nothing you can argue, souls or not, that will convince me otherwise that these are not just computer programs like any other computer programs. If the LLM has a consciousness, then so does MS paint.