> Each word has nearly 5 billion calculations behind its choice

If you mean "the words picked by LLMs have nearly 5 billion calculations behind", then the reply is simply "LLMs are easily effing morons" - those calculations must be not well spent or not enough.

And in the example, the paid «expert» (which is actually meant to be "the professional" - expert, talented and educated) is the human, not the machine.

Two big reasons spring to mind, client privacy and trust. This therapist was quite literally dumping confidential medical information to a third party corporation without telling the patient their information was being shared and disclosed with outside entities. The broader issue if patient trust in the ability or professionalism of the therapist are a whole other issue.

What fraction of those 5 billion calculations are about the patient? How meaningful, how valuable, is a single one of those calculations? How many of those calculations does a human brain perform per word?