So just because all the parts are collaborating to get the desired outcome, and specific aspects of that outcome cannot be contributed to specific parts of the llm you think we don’t understand LLMs? With mixture of expert systems we’re introducing dedicated subsystems into the llm responsible for specific aspect of the llm, so we’re partially moving in that direction.

But overall in my opinion if devs are able to rebuild it from scratch with a predefined outcome, and even know how to improve the system to improve certain aspects of it, we do understand how it works.