The title encompasses my thoughts about the LLM perfectly. It is amazing to see that a very weird concept (randomising data, testing it, and randomising the best ones at predicting the next tokens again) would work but it seems to do.

Of course, this is not intelligence. these chatbots should come with a "HEY THIS IS NOT INTELLIGENT AND VERY NOT A HUMAN" warning sticker.

Yet, I wonder were we are in the hype cycle. If have hopes if this will somehow go on to improve.

Maybe by AI companies fine-tuning on initial prompt -> last response [what the user accomplished, by prompting gpt incrementally] pairs?,

I think we could come like 50-60% close to what a human mind can accomplish.

last thought; from my own experience, toddlers sometimes hallucinate / string random words together, too.