To me the most interesting aspect of LLMs is the way that they reveal cognitive 0-days in humans.
The human race needs patches to cognitive firmware to deal with predictive text... Which is a fascinating revelation to me. Sure it's backed up by psych analysis for decades but it's interesting to watch it play out on such a large scale.
The illusion of emergence is fact not fiction. The cognitive biases exposed by stochastic parrots are fact not fiction.
It is a philosophical argument to say that a machine isn't truly intelligent because it isn't using the same type of neural network as a human
There are some really good bulshitters who have led smart people into deep trouble. These bulshitters behaved really like ducks but they weren't ducks. The duck test just isn't good enough.
The -1 day is where people say that because LLMs behave like humans then humans must be based on the same tech. I just wonder if these people have ever debugged a complex system only to discover that their initial model of how it worked was way off.