<< LLM tech will never lead to AGI.
I suspect this may be one of those predictions that may not quite pan out. I am not saying it is a given, but never is about as unlikely.
I suspect this may be one of those predictions that may not quite pan out. I am not saying it is a given, but never is about as unlikely.
Like at the moment I think during training new data changes all the model weights which is very compute intensive and makes it hard to learn new things after training. The human brain seems to do it in a more compartmentalised way - learning about a new animal say does not rewrite the neurons for playing chess or speaking French for example. You could maybe modify the LLM algo along those lines without throwing it away entirely.
So you might improve algorithms (by doing matrix multiplications in a different order.... it's always matrix multiplications) but you'll be feeding them junk.
So they need ever increasing amounts of data but they are also the cause of the ever increasing shortage of good data. They have dug their own grave.
'Machine will always know where to go from here on now'.
It’s not the hardware, it’s the algorithms.
I think _maybe_ quantum computing might be the tech that moves AGI closer. But I'm 99.9999% certain it won't be LLM tech. (Even I can't seriously say 100% for most things, though I am 100% certain a monkey will not fly out of my butt today)