In the contexts in which polygraphs are applied (i.e. security clearance, witch hunts within security services), simply being suspicious in this way is enough to cause the negative outcome (i.e. not getting the clearance, getting fired), so even if it might muddy the evaluation of your response to, i.e. "Are you a Russian spy?" it would still cause the negative outcome.
It has no bearing on criminal prosecution, because polygraphs are already inadmissible.