Would be better to extend to use Llama 2 and break itself away from an open ai dependency. However I think this is striking in the right direction with LLM, embed them in a goal based agent framework with a variety of abilities and available actions that are mediated by planners, optimizers, constraint systems, etc, using the abductive capabilities of LLM for providing the abstract semantic glue and delegating other functions to classical AI and algorithms.

I always find it weird people are obsessed with LLMs being unable to solve quadratic equations or recite pi to some digit or play chess. That’s not the interesting abilities they demonstrate, and we already have techniques that do those tasks as good as you would ever need or want. But we have never had something that can operate in a natural language space and “reason” in that abstract space so effectively. That language alone is sufficient to bring out such amazing capabilities is cool, and mixing models and techniques using LLM as a glue between them will be (IMO) where they really change things.