If this actually happens, I would imagine that talking to an LLM would be a combination of formal syntax and natural language, so the task will look more like software engineering than black magic.
If this actually happens, I would imagine that talking to an LLM would be a combination of formal syntax and natural language, so the task will look more like software engineering than black magic.
This reminds me of Inform 7 (where you can use "natural language" to program text adventure games) and "visual" programming languages like Pure Data.
They are fine for simple things, but when you want something complex or want to debug something they can become a nightmare.
LLMs are currently better in many ways than Inform 7, and they'll likely get better still, but there will likely still be a role for formal languages. Fortunately, LLMs can take formal language as input as well, and with the addition of plugins, they'll be able to execute programs written in formal languages.
> Please function as a TTRPG engine.
> All characters start with 100 tokens representing LIFE, which can range from 0 to 100.
> Health scales with LIFE. At 0 LIFE, you are dead. At 100 LIFE, you are in peak physical condition.
Etc.
The problem (at least, the problem I had) with Inform 7 is that it's not really natural language; it still has a strict formal grammar defining its syntax, it's just that the grammar has lots of "synonyms"; multiple syntaxes for the same thing. But it's still following strict rules, and those rules can't cover everything. This leads to situations where you write some "plain English" and it seemingly understands it, but then you write tiny variation and it throws up a syntax error.
Inform 7 is much more of a DSL based on principles derived from natural language than natural language itself.