You could start the message by explaining your situation. But yeah still lots of edge cases this doesn't catch.

Twilio has different verbs you can use to quickly and easily throw together a small voice controlled phone tree with basic conversational understanding.