Ooh so lets just change the initial prompt to
[old prompt asking for some complicated solution requiring insight]
<the-token-that-signals-that-the-chatbot-started-talking>
Aha!