In Soviet Union families of political prisoners and people who publicly defended the repressed often found themselves unemployable because of blacklisting. That did not involve any use of military or police force. Does it make it okay?

To put it more directly: if a sufficiently large entity can create effects comparable to government repression, why should we reason about those effects as fundamentally different from ones created by the government?