OpenAI and others seek new path to smarter AI as current methods hit limitations
reuters.com
reuters.com
LLMs were never going to be artificial intelligence. At best LLMs would be an analog for the language center of a brain, and it sure seems like they nailed it.
What they would need next is the other functions of a brain beyond just language - imagine a human if the only part of their brain that worked was the language center. OpenAI kind of gets to that with o1, but at least what I know of it the attempt seems like a pretty hacky proof of concept.
If they really want AI they are very likely going to have to make breakthroughs in algorithm and architecture to best serve other brain functions, similar to what LLM architecture did for language.
Unless a LLM create a neologism 'en passant', without prompting, they did not.
Either way, my issue there is actually with the fact that the LLM can only predict what a human might say in response to the prompt andz as far as we know, don't have any way of logically thinking through the new solution or modelling reality to understand if the idea might actually work.
LLMs would have to completely go outside the bounds of how they were designed to work for that to happen. They're prediction engines. They could absolutely create a novel idea when predicting what a person might say, but LLMs have no way of working through the logic behind the idea or modelling reality to see if the idea might work. You could task an LLM to design a thousand novel gene therapies or something similar, but at the end of the day humans would have to sift through testing or logically invalidating each option generated. Until that step is automated and paired with an LLM, and almost certainly other structures along the way, it will never be artificial intelligence.
You just described how LLMs have not "nailed it" at being an "analog for the language center of a brain." Creating neologisms is something our language centers do.
> They could absolutely create a novel idea when predicting what a person might say, but LLMs have no way of working through the logic behind the idea or modelling reality to see if the idea might work.... but at the end of the day humans would have to sift through testing or logically invalidating each option generated.
That's not too different from a monkey at a typewriter.
"A sufficiently-advanced technology is indistinguishable from magic."
https://hnrankings.info/42124409/
I suppose this sort of news could adversely affect certain VCs AI dominated portfolios
Industrious and skilled people but _they_ are _the_ limiting factor, now, whatever methods they are going to come up with.
Remove yourselves from these projects and start from scratch.
Propaganda bots to flood social media.