Yeah what I’m thinking about is that and how an LLM could use ASTs expressed in some type of compact encoding and with that code tied to english descriptions, perhaps it will learn really well the semantic cross space.
Like stochastically generate into an intermediate representation that can be procedurally compiled to code right?