Perhaps there could be something like a formal language we could use to interface with the models, to help assuage the trickiness of natural language prompting.
We could declare certain pieces of the prompt as "variables," and certain defined operations that have proven deterministic output as "functions." All so that what we want the computer to do can be rigorously defined and tested.