I was worried about the same thing. I couldn't find a solution so I kinda just accepted that if they misinterpreted me then that's ok. I politely back off and leave them alone. It feels awkward the few days after but I quickly got used to it and I have had no issues afterwards. I'm sorry if this didn't help, I know I'm basically saying jUsT aCcEpT iT