5,480 karma · joined May 7, 2013
So what is it that we don't understand about why theyr work? The algorithm? We have the code. Why the specific algorithm makes such good predictions? I see it as a generalization of trying to predict who wins Kentucky Derby.
It is the combination of LLM and agent-harnesses that make it look really smart. Agent-harness is a programmatic device that lets us tap into the vast knowledge in the LLM.
It is probabaly true that many TV-commentators fail to appreciate this fact and therefore think LLMs are super-intelligent. No, it is the combination of LLM and the programmatic agent-haness that is the breakthrough.
An interesting thought is that the LLM could in theory code the agent-harrness, start it running every time we interact with it. Currently the agent-harrness I think is pretty static I think. In theory it could be dynamically created for every task. Would that make it better don't know.
I also gave some presentations in IT-related conferences. People in conferences often get tired. So once as I entered the lectern I turned on a piece of music I had on my thumb-drive. It was the loudest hardest Rock'n'Roll I had. The audtorium had good loud-speakers. I think it woke the audience up. But soon I saw them nodding again. :-)
But I don't want to souond too pessimistic, there are lots of good people and progress is inevitable. AI gets put down a lot but I think it will make people much smarter.
Maybe briefly show how that adavanced topic will be taught and let them realize they can not possible even start to understand advanced topic because they are missing the more elementary pieces.
Similarly why they can't got further without doing their homework. How mastering the homework exercises let's you solve more problems.
I know that is not easy, the teacher may not quite understand how topics relate, why each of them is needed in a specific order, if they have not thought about that much.
But LLM has similar capability, it can look at its previous outputs, and think what further thoughts the it should generate next based on those. It can keep some of its outputs to itself, thinking in its own head,and can examine it previous private thoughts easily.
Not sure how much current LLMs do that but clearly they can at least in theory use their own outputs as their inputs too.
Current LLMs however are not conscious of pleasure and pain which really is the root of goal-oriented behavior. But maybe something like that could be programmed into them.
How would you cause an LLM pain? Or pleasure?
Solution might be legislation that puts limits on how much money each person can spend on elections. But it may be too late, there are so many rich people in the congress that such laws can not pass.
The rich not only want to get richer they also want the lower classes to get poorer so they will work for less and will have to work longer hours so they will have less time and money to educate themselves, and thus will remain clueless about what is going on.
It Catches: Mismatched function arguments, missing object properties, and typos in variable names.
It Misses: Invalid JSON from an API, unexpected database outputs, and bad user input.
That is a very good thing to help us reason about the program, we have invariants we know must hold true if the program does not stop in a type-error.
It's bit like with doctors, you'll want a second opinion, if you can afford it.
THEN I find a human lawyer and give AI's answers to them and say "Can you find any errors in this? Can you improve it?" .
That way I think my legal bills should be smaller because the AI has already done most of the work. What do you think? Which LLM is best for legal work?
Overall the code gets smaller and easier to understand when it only has things that need to be there. If you comment out a an unused variable you can see from find-results that in effect that occurrence cannot matter.
Unused variables are "noise" that hide actually important things.
Therefore we will need people who are skilled at creating apps with the help of AI. AI can not do that for us, someone is needed to figure out what apps we need. So AI will empower programmers, not replace them. Of course if you are unwilling to learn how to use AI as part of your tool-chain you might lose your job.
Trump often said "Tariffs is the most beautiful word". I think he said that because he thought his followers were too stupid to realize that he was transferring tax-burden from the rich to the middle-class and poor. That's why he thought they were "beautiful". They enabled him to gaslight people.
American people are not stupid but many of us have to work hard so there's not a lot spare time nor energy to try understand what is actually happening. Fox News is misleading us purposefully playing emotional tricks on patriotic Americanss.
Now import-companies should get back the tariffs they paid. But does it mean they will lower their prices? Probably not.
Just because somebody tells us they are not lying does not mean they are not. But some people believe it because it makes them feel great again.
I don't know but I would expect it to be relatively easy for an LLM to detect "hallucinations".
I don't know but I would expect it to be realtively easy for an LLM to detect "hallucinations".