LLMs are not ever going to be a path towards AGI. What we are calling AI today is light-years away from AGI or "sentience".
This is our third or fourth false start but I see no path to AGI using LLMs.
Its honestly sad to see so many people being tricked by statistics once again but there is absolutely nothing intelligent about GPTs right now, it's a statistical model not a thinking machine.