In which capabilities are AI not already close to or beyond that of a human brain?
In which capabilities are AI not already close to or beyond that of a human brain?
* Forming a long lasting memory from a single encounter
* Speed of adaptation to new environments
* Deft manual dexterity, like playing the violin and needlework
* Competing in a triathlon (requires running, biking, and swimming)
* Having a single agent that can do ALL of those things and more
Humans understand and perform tasks in many more than just the few modalities current model providers have focused on. I'm not discounting the utility of current models in the limited domains they operate in, but they are no where close to being generalists like a human or other animals.
seems like a very short timeline to me.
Rap lyrics are a good test. They are on the level of a censored version of Insane Clown Posse. Just terrible.
None of the models I've downloaded have sprung to life spontaneously, or done anything remotely unpredictable. None of them can act without input. They all have strictly limited ways to receive input and pass output. They aren't alive, can't feel, don't have experiences. The fact that they are a phenomenon that emerge from billions of snippets of our language lets them express languages in extremely convincing ways, and they are extremely impressive in what they can do. But this isn't Short Circuit or D.A.R.Y.L. or the Terminator, none of them have feelings. None of them continue to think after the program exits.
Without those characteristics they can only generate based on what they've ingested. The capabilities are still astonishing, but they're still dead things, and nobody will ever risk their life to protect the model "context" from getting "killed"
Transformers can also become confused be texts that no humans become confused by. I wrote some stories that I've used as test material, where I deliberately refuse to say who is speaking, or whose perspective we see, but where it is obvious to a human who it must be, and LLMs can make huge screwups in those texts. Mixing up an old guy with a young guy who he, when he was a similar age, was similar to, mixing up a kid with the kid's mother, that sort of thing.
I think the first part has no know solution. The second part is probably solvable, but not with a transformer-- maybe if they could make notes or output reasoning traces during prefill.
Both problems are hard and unsolved though.
It can’t even play a basic video game!
Now it can
It can never beat the best human go player!
Now it can
It can’t even make a video of will smith eating food!
Now it can
It can’t do basic math!
Now it can
It can’t code as well as a junior?
Not it can
It can’t pass the bar or other certificate exams!
Now it can
It’s never going to meet senior level programmers!
Now Linus says it’s better at coding than him
It can’t do high level maths!
Now it can
It can’t solve math problems humans cant!
Now it can
It can’t do RSI
…
That old thing?