I was surprised to see the omission of a prompt technique called program-aided prompting.

Paper: https://arxiv.org/abs/2211.10435 GitHub: https://github.com/reasoning-machines/pal

tl;dr -- LLMs are bad at basic arithmetic and logic (as their opening examples with math word problems show), but they do much better if instead of asking them for the answer, you ask for code to compute the answer. Then evaluate or run the code to get the answer.