It plays off of the "if it looks like a duck, quacks like a duck, and walks like a duck" idiom, which of course isn't foolproof and gives avenue to the kind of spectacular advertising that is fueling this hype.
My mom was lamenting car insurance quotes, so I told her to ask AI. She did, then had it do a Monte Carlo simulation for all the insurances she the AI felt she was qualified for.
It happily replied that it did 1 million monte carlo simulations and here was the result.
To this day I don't think she fundamentally groks that LLMs cannot calculate.
They're getting quite good at that now.
Can't most LLMs trivially use Python and other languages and libs and calculate?