What if intelligence is an product of consciousness, and consciousness is an product of something that can never have a physical definition and is always ethereal... i.e. a "soul".
If we can achieve AGI simply through more and more computation, no matter how novel it is, its ultimately ifs, loops and arithmetic... then surely the human experience is ultimately just a 'wet LLM' (or whatever we end up calling the machine learning technology behind AGI).