Fundamentally, the question is this: what is a large language model, what is it capable of, how does it differ from human cognition, and what can humans do that it cannot do?

A lot of people seem to believe that with more time and training, LLMs will surpass human intelligence. But they are fundamentally not like human intelligence. They do not reason, learn, conceptualize, think creatively or abstractly, even though we have some hacks to mimic these behaviors.

I posit that treating LLMs like GPU-powered brains that will eventually surpass us in most fields is pure science fiction if you know anything about how they work. I think they will remain astronomically powerful in some areas (pertaining to fuzzy deep search and recombining existing knowledge) and hilariously bad in others.