> If you expect the models you use to change at all, it’s important to unit-test all your prompts using evaluation examples.

It's mentioned earlier in the article, but I'd like to emphasize that if you go down this route that you should either do multiple evaluations per prompt and come up with some kind of averaged result, or set the temperature to 0.

FTA:

> LLMs are stochastic – there’s no guarantee that an LLM will give you the same output for the same input every time.

> You can force an LLM to give the same response by setting temperature = 0, which is, in general, a good practice.