I think the next step logically is to see how the human brain functions. We have a similar model where certain parts of our brain are hopelessly useless by themselves as they are so overly specialized in one thing, but work in harmony to create network effectiveness.
And we only just [mapped it for the first time](https://phys.org/news/2023-10-scientists-generate-single-cel...) so now much of what we are learning can potentially be applied to our “digital twins” in coming years.
I imagine a lot of progress with AI will involve similar networks, with governance providing evolutionary paths and guidance for multiple concurrent goals.
There are also lots of issues with training data and memory limits that make LLMs weak at continuity. Holes or weaknesses in the training data might “come through” in the behavior of hallucination.
Where do you think general AI is going right now that we should be looking at? I’m overwhelmed by how large this field has become in the last five years and am always interested in what others know.