> It might be boring but it is the truth.
The inability of people to reflect on their own beliefs amazes me to no end. How can you know that LLMs have no phenomenal states?
For example, I believe that rocks (ordinary rocks, not silicon chips) have no phenomenal states because for all we know they don't do any kind of information processing (relevant to self-reflection, at least) and I don't believe in panpsychism or dualism.