> as long as they know they are talking to a model

Any evidence for this?

It's obvious that a sufficiently advanced AI could solve loneliness if it was allowed to present as human, you just wouldn't know it isn't one. I'm entirely unconvinced that something which seems human in all respects couldn't replace one, even if your brain knows that it's actually AI.