Society doesnt require undergrad essays. Nor does it require yet another webserver, iot script, or weekend hobby project. Society has all of those things already, hence the ability to train LLMs to produce them.
"Society", the economy, etc. are operating under competitive optimisation processes -- so that what is valuable, on the margin, is what isn't readily produced. What is readily produced, has been produced, is being produced, and so on. Solved problems are solved problems. Intelligence is the capacity of animals to operate "on the margin" -- that's why we have it:
Intelligence is a process of rapid adaption to novel circumstances, it is not, unlike puzzle-solvers like to claim, the solution to puzzles. Once a puzzle is solved so there are historical exemplars of its solution, it no longer requires intelligence to solve it -- hence using an LLM. (In this sense computer science is the art of removing intelligence from the solving of unsolved and unposed puzzles).
LLMs surface "solved problems" more readily than search engines. There's no evidence, and plenty against, that they provide the value of intelligence -- their ability to advance one's capabilities under compeititon from others, is literally zero -- since all players in the economic (, social, etc.) game have access to the LLM.
The LLM itself, in this sense, not only has no intelligence, but doesnt even show up in intelligent processes that we follow. It's washed out immediately -- it removes from our task lists, some "tasks that require intelligence", leaving the remainder for our actual intelligence to engage with.
...and i encourage you to be more realistic about the market and what society "needs". does society really need an army of consultants at accenture? i dont know. but they are getting paid a lot. does that mean the allocation of resources is wrong? or does that mean theres something cynical but real in their existence?
But the key difference between a model and a human is exactly what you just said. It's what animals can do on the margin. Nobody taught humans language. Each of us individually who are alive today, sure. But go back far enough and humanity invented language. We directly interact with the physical world, develop mental models of it, observe that we are able to make sounds and symbols and somehow come to a mutual agreement that they should mean something in rough analogy to these independent but sufficiently similar mental models. That is magic. Nobody, no programmer, no mathematician, no investor, has any idea how humanity did that, and has no idea how to get a machine to do it, either. Replicating the accomplishments of something else is a tremendous feat and it will get our software very, very far, maybe as far as we ever need to really get it. But it is not doing what animals did. It didn't just figure this shit out on its own.
Maybe somewhat ironically, I don't even know that this is a real limitation that current techniques for developing statistical models can't overcome. Put some "AIs" loose in robot bodies, let them freely move about the world trying to accomplish the simple goal of continuing to exist, with cooperation allowed, and they may very well develop ways to encode knowledge, share it with each other, and write it down somehow to pass on to the future so they don't need to continually re-learn everything, especially if they get millions of years to do it.
It's obvious, though, that we don't even want this. It might be interesting purely as an experiment, but it probably isn't going to lead to any useful tools. What we do now actually does lead to useful tools. To me, that should tell us something in these discussions. Trying to figure if X piece of software is or isn't cognitively equal to or better than a human in some respect is a tiring, pointless exercise. Who cares? Is it useful to us or not? What are its uses? What are its limitations? We're just trying to automate some toil here, aren't we? We're not trying to play God and create a separate form of life with its own purposes.
add 1 and 1
google/gemma-3-4b 1 + 1 = 2
add four to that
google/gemma-3-4b 1 + 1 + 1 + 1 = 4
So, 1 + 1 + 1 + 1 + 4 = 8
Of course, smarter, billion dollar LLMs can do that. But, they aren't able to fetch one of 30 objects based on name, nor can they drive a car. They're often super-important components of much larger systems that are, at the very least, getting really close to being able to do these things if not able to already.
It should be worldview-changing to realize that writing a graduate-level research essay is, in some ways, easier than adding 4 to 2. Its just not easier for humans or ALUs. It turns out, intelligence is a multi-dimensional spectrum, and words like "smart" are kinda un-smart to use when describing entities who vie for a place on it.
More likely they will say "lol, i don't know". And this is better than a lot of LLM output in the sense that it's aware of its limits, and doesn't hallucinate.
1. "LLMs are smart they have intelligence that is some significant portion of the breadth of human cognition."
2. Me: "ALUs are also smart, maybe that's not a good word to use."
3. "But LLMs can write essays."
4. Me: "But they can't do basic math, so clearly there's different definitions of the word 'smart'"
5. "Yeah that's because they're vibe-solving math. Teenagers also operate on vibes."
What are you even talking about?? Its like you're an AI programmed to instantly attack any suggestion that LLMs have limitations.
i only respond to the most interesting shit. most ppl jump in with something interesting and then gish gallop into nonsense because they at some point were taught that verbosity is good