One of the problems is a lack of architectural memory in LLM's context.