well, of course this is the basic problem with these systems - how to resolve?
It’s even pretty common for us humans to hallucinate outputs.
Remember that restaurant we went to in Rome where we had pizza?
No, it was Paris, and we didn’t have pizza we had crepes.
We’re not that different.
Then because we are social animals, we presume without evidence that this is the same for other people as well.
We (most of us anwyay) don't form social bonds with machines, so there lies the difference.
There's a difference, but "merely" a social one.
The loneliness epidemic is widespread and an AI "friend" is palliative.
Sadly, it's not that the artificial voice is replacing the authentic human relationship.