Agreed - I find it a bit of a failing for an intelligent human to assign agency to a token-predictor that has neither personality nor understanding.
However, since we're talking about fiction and metaphors, I find it lacking in nuance.
I understand that you are compelled to repeat the idea that "it's just a next word predictor", and it probably is, but I'm not sure if the agency and consciousness discussions fit the theme of the conversation.