I'm not ML practitioner, so idk, but could we get generative tool that operates on higher syntatic level (e.g. AST) instead of interpreting code as just plain text? I feel it's so dumb that something like copilot generates code that is syntatically invalid, that feels like low bar for any code generation tool to pass?