It's not a good measurement.
Sure, but who has had a good conversation with a clock?
> people even have satisfying emotional conversations with teddy bears.
No they don't. Kids know very well that they're pretending to have conversations. The people who actually hear teddy bears speak also know that that's not normal, and we all know that this is a cognitive distortion.
This is also true of those who form emotional attachments with current AI. The people developing romantic relationships with Replika etc. aren't engaging in healthy behaviour.
This article mentions excitement about neural networks overgeneralizing verb inflections, which human language learners also do. If neural networks lead to the discovery of new examples of human cognitive or perceptual errors or illusions, or to the discovery of new effective methods for learning, teaching, or psychotherapy, that could count as evidence that they're a good model of our actual minds.
How would they, except as tools for analyzing research rather than research models? They don't work like human brains, so while they might sometimes exhibit something that looks like similar behavior when viewed a certain way, other than already having observed the behavior in human beings, there’s no reason to expect something they do to reflect what human brains, and moreover there’s no reason to expect useful insights from the corresponding behavior, since there is no reason to expect that the behavior responds similarly outside of the conditions where it is observed in both systems, leaving all the insight on the brain to cone from the brain (or models that, unlike artificial neural nets, we know have structural and behavioral similarities with (some parts of) human brains that are useful.)